2024-04-25T12:43:08.491 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T12:43:08.491 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} --archive /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448 --name leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi --verbose --owner scheduled_leonidus@teuthology -- /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/orig.config.yaml 2024-04-25T12:43:08.544 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T12:43:08.629 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} email: null first_in_suite: false job_id: '7673448' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 4060 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 4d7908725372ec8e17504b848bfa122dd1d43386 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuNkucXJ59SCCtKF9QP3S/igSOJVVar6YZHqvGRg/PZNNcojFxZfKZIT+B6eAt7JKG80Vn1P2cImAhhzrdwapE= smithi157.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIN6oMNfw4CzQMukc5lb6k7IFKiz9TxPa2AnDYcuE1VjUzAcxklYW5IFuOjAwz6YhvLzaraq0FcFETCAUZwezo= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - kclient: null - quiescer: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_12:17:05 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T12:43:08.630 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa; will attempt to use it 2024-04-25T12:43:08.630 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks 2024-04-25T12:43:08.630 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T12:43:08.632 INFO:teuthology.task.internal:Checking packages... 2024-04-25T12:43:08.657 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-25T12:43:08.657 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T12:43:08.657 INFO:teuthology.packaging:ref: None 2024-04-25T12:43:08.657 INFO:teuthology.packaging:tag: None 2024-04-25T12:43:08.657 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-25T12:43:08.657 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:43:08.658 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-lusov-quiescer 2024-04-25T12:43:08.815 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156.gd69f13d8 2024-04-25T12:43:08.817 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T12:43:08.824 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T12:43:08.824 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T12:43:08.832 INFO:teuthology.task.internal:Saving configuration 2024-04-25T12:43:08.852 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T12:43:08.858 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:43:08.882 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:37:27.234812', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuNkucXJ59SCCtKF9QP3S/igSOJVVar6YZHqvGRg/PZNNcojFxZfKZIT+B6eAt7JKG80Vn1P2cImAhhzrdwapE='} 2024-04-25T12:43:08.902 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:37:27.236291', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIN6oMNfw4CzQMukc5lb6k7IFKiz9TxPa2AnDYcuE1VjUzAcxklYW5IFuOjAwz6YhvLzaraq0FcFETCAUZwezo='} 2024-04-25T12:43:08.902 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T12:43:08.910 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-25T12:43:08.911 INFO:teuthology.task.internal:roles: ubuntu@smithi157.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-25T12:43:08.911 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T12:43:08.980 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c2c4950d0>, signals=[15]) 2024-04-25T12:43:09.007 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T12:43:09.014 INFO:teuthology.task.internal:Opening connections... 2024-04-25T12:43:09.014 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:43:09.017 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:43:09.099 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:43:09.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:43:09.177 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T12:43:09.183 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2024-04-25T12:43:09.201 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2024-04-25T12:43:09.202 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2024-04-25T12:43:09.259 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2024-04-25T12:43:09.259 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2024-04-25T12:43:09.259 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2024-04-25T12:43:09.259 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2024-04-25T12:43:09.259 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2024-04-25T12:43:09.259 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T12:43:09.260 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T12:43:09.261 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2024-04-25T12:43:09.289 DEBUG:teuthology.orchestra.run.smithi157:> uname -m 2024-04-25T12:43:09.307 INFO:teuthology.orchestra.run.smithi157.stdout:x86_64 2024-04-25T12:43:09.308 DEBUG:teuthology.orchestra.run.smithi157:> cat /etc/os-release 2024-04-25T12:43:09.364 INFO:teuthology.orchestra.run.smithi157.stdout:NAME="CentOS Stream" 2024-04-25T12:43:09.364 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION="9" 2024-04-25T12:43:09.364 INFO:teuthology.orchestra.run.smithi157.stdout:ID="centos" 2024-04-25T12:43:09.364 INFO:teuthology.orchestra.run.smithi157.stdout:ID_LIKE="rhel fedora" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:VERSION_ID="9" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:PLATFORM_ID="platform:el9" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:ANSI_COLOR="0;31" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:LOGO="fedora-logo-icon" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:HOME_URL="https://centos.org/" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-25T12:43:09.365 INFO:teuthology.orchestra.run.smithi157.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T12:43:09.365 INFO:teuthology.lock.ops:Updating smithi157.front.sepia.ceph.com on lock server 2024-04-25T12:43:09.389 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T12:43:09.400 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T12:43:09.406 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T12:43:09.407 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2024-04-25T12:43:09.410 DEBUG:teuthology.orchestra.run.smithi157:> test '!' -e /home/ubuntu/cephtest 2024-04-25T12:43:09.426 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T12:43:09.435 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T12:43:09.435 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2024-04-25T12:43:09.467 DEBUG:teuthology.orchestra.run.smithi157:> test -z $(ls -A /var/lib/ceph) 2024-04-25T12:43:09.504 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T12:43:09.551 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T12:43:09.572 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-04-25T12:43:09.572 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-04-25T12:43:09.572 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-04-25T12:43:09.573 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T12:43:09.590 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:43:09.591 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2024-04-25T12:43:09.649 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-437.el9.x86_64 2024-04-25T12:43:09.649 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-437.el9.x86_64 2024-04-25T12:43:09.649 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2024-04-25T12:43:12.508 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 6.6 MB/s | 8.0 MB 00:01 2024-04-25T12:43:14.426 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 22 MB/s | 19 MB 00:00 2024-04-25T12:43:18.561 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.2 MB 00:00 2024-04-25T12:43:20.116 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 16 kB 00:00 2024-04-25T12:43:21.193 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 22 MB/s | 21 MB 00:00 2024-04-25T12:43:26.192 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-04-25T12:43:28.074 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-04-25T12:43:28.074 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-04-25T12:43:28.162 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T12:43:28.163 INFO:teuthology.orchestra.run.smithi132.stdout:Nothing to do. 2024-04-25T12:43:28.164 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-25T12:43:28.273 DEBUG:teuthology.orchestra.run.smithi132:> echo no | sudo yum reinstall kernel || true 2024-04-25T12:43:28.770 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:02 ago on Thu 25 Apr 2024 12:43:26 PM UTC. 2024-04-25T12:43:28.888 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalling: 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:43:28.899 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 255 k 2024-04-25T12:43:28.900 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2024-04-25T12:43:28.900 INFO:teuthology.orchestra.run.smithi132.stderr:Operation aborted. 2024-04-25T12:43:28.959 INFO:teuthology.orchestra.run.smithi132.stdout:Is this ok [y/N]: 2024-04-25T12:43:28.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum reinstall -y kernel || true 2024-04-25T12:43:29.454 INFO:teuthology.orchestra.run.smithi132.stdout:Last metadata expiration check: 0:00:03 ago on Thu 25 Apr 2024 12:43:26 PM UTC. 2024-04-25T12:43:29.570 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalling: 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-437.el9 baseos 255 k 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:43:29.571 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 255 k 2024-04-25T12:43:29.572 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 0 2024-04-25T12:43:29.572 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-25T12:43:30.311 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-437.el9.x86_64.rpm 580 kB/s | 255 kB 00:00 2024-04-25T12:43:30.311 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-25T12:43:30.312 INFO:teuthology.orchestra.run.smithi132.stdout:Total 344 kB/s | 255 kB 00:00 2024-04-25T12:43:30.328 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-25T12:43:30.496 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-25T12:43:30.496 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-25T12:43:30.501 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-25T12:43:30.501 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-25T12:43:30.616 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-25T12:43:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: Reinstalling : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T12:43:30.696 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T12:43:31.355 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T12:43:31.355 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 1/2 2024-04-25T12:43:32.086 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-437.el9.x86_64 2/2 2024-04-25T12:43:32.087 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:43:32.087 INFO:teuthology.orchestra.run.smithi132.stdout:Reinstalled: 2024-04-25T12:43:32.087 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-437.el9.x86_64 2024-04-25T12:43:32.087 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:43:32.087 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-25T12:43:32.273 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T12:43:32.361 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-437.el9.x86_64 2024-04-25T12:43:32.361 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-437.el9.x86_64 2024-04-25T12:43:32.362 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2024-04-25T12:43:32.362 DEBUG:teuthology.parallel:result is None 2024-04-25T12:43:32.362 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T12:43:32.369 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T12:43:32.369 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T12:43:32.372 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T12:43:32.390 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T12:43:32.397 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T12:43:32.409 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T12:43:32.409 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T12:43:32.427 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T12:43:32.557 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T12:43:32.563 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T12:43:32.564 DEBUG:teuthology.orchestra.run.smithi157:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T12:43:32.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:43:32.580 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T12:43:32.583 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T12:43:32.608 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:43:32.640 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:43:32.660 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:43:32.684 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T12:43:32.686 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T12:43:32.694 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T12:43:32.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T12:43:32.697 DEBUG:teuthology.orchestra.run.smithi157:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T12:43:32.753 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T12:43:32.764 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T12:43:32.764 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T12:43:32.767 DEBUG:teuthology.orchestra.run.smithi157:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T12:43:32.810 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:43:32.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:43:32.916 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:43:32.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:43:33.036 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:43:33.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T12:43:33.099 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:43:33.143 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T12:43:33.192 DEBUG:teuthology.orchestra.run.smithi157:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:43:33.275 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T12:43:33.316 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:43:33.316 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T12:43:33.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2024-04-25T12:43:33.384 DEBUG:teuthology.orchestra.run.smithi157:> sudo service rsyslog restart 2024-04-25T12:43:33.419 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T12:43:33.465 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T12:43:33.956 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T12:43:33.965 INFO:teuthology.task.internal:Starting timer... 2024-04-25T12:43:33.965 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T12:43:33.978 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T12:43:33.986 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-25T12:43:33.986 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2024-04-25T12:43:34.044 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2024-04-25T12:43:34.046 DEBUG:teuthology.orchestra.run.smithi157:> sudo service auditd rotate 2024-04-25T12:43:34.101 INFO:teuthology.orchestra.run.smithi157.stdout:Rotating logs: 2024-04-25T12:43:34.103 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T12:43:34.103 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2024-04-25T12:43:34.137 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2024-04-25T12:43:34.137 DEBUG:teuthology.orchestra.run.smithi157:> /usr/sbin/getenforce 2024-04-25T12:43:34.162 INFO:teuthology.orchestra.run.smithi157.stdout:Permissive 2024-04-25T12:43:34.162 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi157.front.sepia.ceph.com': 'permissive'} 2024-04-25T12:43:34.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T12:43:34.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:43:34.203 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T12:43:34.230 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:43:34.230 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T12:43:34.231 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2024-04-25T12:43:34.266 DEBUG:teuthology.orchestra.run.smithi157:> sudo /usr/sbin/setenforce permissive 2024-04-25T12:43:34.306 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T12:43:34.316 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T12:43:34.321 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T12:43:34.446 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T12:43:34.461 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T12:43:34.462 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi157.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T12:47:26.462 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi157.front.sepia.ceph.com')] 2024-04-25T12:47:26.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-25T12:47:26.464 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:47:26.541 DEBUG:teuthology.orchestra.run.smithi132:> true 2024-04-25T12:47:26.617 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2024-04-25T12:47:26.617 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-25T12:47:26.618 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi157.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T12:47:26.691 DEBUG:teuthology.orchestra.run.smithi157:> true 2024-04-25T12:47:26.768 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi157.front.sepia.ceph.com' 2024-04-25T12:47:26.769 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T12:47:26.779 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T12:47:26.779 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T12:47:26.780 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:47:26.782 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T12:47:26.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:47:26.808 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T12:47:26.822 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T12:47:26.836 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T12:47:26.845 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2024-04-25T12:47:26.850 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T12:47:26.856 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2024-04-25T12:47:26.868 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T12:47:26.872 INFO:teuthology.orchestra.run.smithi157.stderr:sudo: ntpd: command not found 2024-04-25T12:47:26.882 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T12:47:26.882 INFO:teuthology.orchestra.run.smithi157.stdout:506 Cannot talk to daemon 2024-04-25T12:47:26.895 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T12:47:26.908 INFO:teuthology.orchestra.run.smithi157.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T12:47:26.934 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-25T12:47:26.938 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T12:47:26.938 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-25T12:47:26.938 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.938 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.938 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.938 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.962 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-04-25T12:47:26.965 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T12:47:26.965 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-04-25T12:47:26.965 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.965 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.965 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.966 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:47:26.966 INFO:teuthology.run_tasks:Running task install... 2024-04-25T12:47:26.975 DEBUG:teuthology.task.install:project ceph 2024-04-25T12:47:26.975 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-25T12:47:26.975 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-25T12:47:26.975 INFO:teuthology.task.install:Using flavor: default 2024-04-25T12:47:26.980 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T12:47:26.980 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-25T12:47:26.981 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T12:47:26.981 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:47:26.983 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'tag': None, 'wait_for_package': False} 2024-04-25T12:47:26.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:47:27.127 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T12:47:27.127 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T12:47:27.202 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/ 2024-04-25T12:47:27.202 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3156.gd69f13d8 2024-04-25T12:47:27.362 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T12:47:27.363 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:47:27.363 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T12:47:27.387 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T12:47:27.387 DEBUG:teuthology.orchestra.run.smithi157:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T12:47:27.436 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T12:47:27.436 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:47:27.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T12:47:27.454 DEBUG:teuthology.orchestra.run.smithi157:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T12:47:27.463 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-25T12:47:27.463 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d69f13d827952bb07bb9b7973bca14f97d764d6f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T12:47:27.526 DEBUG:teuthology.orchestra.run.smithi157:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T12:47:27.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T12:47:27.589 INFO:teuthology.orchestra.run.smithi157.stdout:check_obsoletes = 1 2024-04-25T12:47:27.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum clean all 2024-04-25T12:47:27.603 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T12:47:27.667 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2024-04-25T12:47:27.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2024-04-25T12:47:27.816 INFO:teuthology.orchestra.run.smithi157.stdout:48 files removed 2024-04-25T12:47:27.843 DEBUG:teuthology.orchestra.run.smithi157:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T12:47:27.894 INFO:teuthology.orchestra.run.smithi132.stdout:48 files removed 2024-04-25T12:47:27.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-25T12:47:28.688 INFO:teuthology.orchestra.run.smithi157.stdout:ceph packages for x86_64 143 kB/s | 83 kB 00:00 2024-04-25T12:47:28.734 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 150 kB/s | 83 kB 00:00 2024-04-25T12:47:29.057 INFO:teuthology.orchestra.run.smithi157.stdout:ceph noarch packages 36 kB/s | 12 kB 00:00 2024-04-25T12:47:29.226 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 26 kB/s | 12 kB 00:00 2024-04-25T12:47:29.598 INFO:teuthology.orchestra.run.smithi157.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-04-25T12:47:29.851 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-04-25T12:47:30.483 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.0 MB 00:00 2024-04-25T12:47:30.721 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 9.6 MB/s | 8.0 MB 00:00 2024-04-25T12:47:32.384 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-25T12:47:33.031 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-04-25T12:47:37.144 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - CRB 4.9 MB/s | 6.2 MB 00:01 2024-04-25T12:47:37.331 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.2 MB 00:00 2024-04-25T12:47:38.775 INFO:teuthology.orchestra.run.smithi157.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-25T12:47:38.946 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-25T12:47:40.271 INFO:teuthology.orchestra.run.smithi157.stdout:Extra Packages for Enterprise Linux 15 MB/s | 21 MB 00:01 2024-04-25T12:47:41.823 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 7.6 MB/s | 21 MB 00:02 2024-04-25T12:47:45.393 INFO:teuthology.orchestra.run.smithi157.stdout:lab-extras 14 kB/s | 1.7 kB 00:00 2024-04-25T12:47:46.889 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2024-04-25T12:47:47.561 INFO:teuthology.orchestra.run.smithi157.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T12:47:47.562 INFO:teuthology.orchestra.run.smithi157.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T12:47:47.572 INFO:teuthology.orchestra.run.smithi157.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T12:47:47.573 INFO:teuthology.orchestra.run.smithi157.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T12:47:47.574 INFO:teuthology.orchestra.run.smithi157.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T12:47:47.575 INFO:teuthology.orchestra.run.smithi157.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T12:47:47.576 INFO:teuthology.orchestra.run.smithi157.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T12:47:47.578 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T12:47:47.579 INFO:teuthology.orchestra.run.smithi157.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T12:47:47.639 INFO:teuthology.orchestra.run.smithi157.stdout:Dependencies resolved. 2024-04-25T12:47:47.654 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: Package Arch Version Repository Size 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout:Installing: 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T12:47:47.655 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T12:47:47.656 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T12:47:47.657 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrading: 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T12:47:47.658 INFO:teuthology.orchestra.run.smithi157.stdout:Installing dependencies: 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T12:47:47.659 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T12:47:47.660 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T12:47:47.661 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T12:47:47.662 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T12:47:47.663 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T12:47:47.664 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T12:47:47.665 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T12:47:47.666 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout:Installing weak dependencies: 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction Summary 2024-04-25T12:47:47.667 INFO:teuthology.orchestra.run.smithi157.stdout:======================================================================================= 2024-04-25T12:47:47.668 INFO:teuthology.orchestra.run.smithi157.stdout:Install 148 Packages 2024-04-25T12:47:47.668 INFO:teuthology.orchestra.run.smithi157.stdout:Upgrade 4 Packages 2024-04-25T12:47:47.668 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:47:47.668 INFO:teuthology.orchestra.run.smithi157.stdout:Total download size: 222 M 2024-04-25T12:47:47.668 INFO:teuthology.orchestra.run.smithi157.stdout:Downloading Packages: 2024-04-25T12:47:48.345 INFO:teuthology.orchestra.run.smithi157.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 29 kB/s | 6.6 kB 00:00 2024-04-25T12:47:48.636 INFO:teuthology.orchestra.run.smithi157.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 3.0 MB/s | 890 kB 00:00 2024-04-25T12:47:48.711 INFO:teuthology.orchestra.run.smithi157.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 1.9 MB/s | 145 kB 00:00 2024-04-25T12:47:49.023 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T12:47:49.024 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-25T12:47:49.034 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-04-25T12:47:49.035 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-25T12:47:49.036 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-04-25T12:47:49.037 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-04-25T12:47:49.038 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-25T12:47:49.041 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-04-25T12:47:49.041 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-04-25T12:47:49.101 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 6.6 k 2024-04-25T12:47:49.110 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 890 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 145 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 1.5 M 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 142 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 3.5 M 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 7.4 M 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 49 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 11 M 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 49 M 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 273 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 762 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 225 k 2024-04-25T12:47:49.111 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 27 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 18 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 32 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 747 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 126 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-25T12:47:49.112 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 161 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 320 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 298 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 99 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 85 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 170 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.4 M 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 3.1 M 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-04-25T12:47:49.113 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 21 M 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 34 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 2.4 M 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 249 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 4.7 M 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 17 M 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3156.gd69f13d8.el7 ceph-noarch 16 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 25 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-25T12:47:49.114 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 163 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 500 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-25T12:47:49.115 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 5.4 M 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-25T12:47:49.116 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 45 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:19.0.0-3156.gd69f13d8.el7 ceph 135 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-25T12:47:49.117 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-25T12:47:49.118 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-25T12:47:49.119 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-25T12:47:49.120 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-25T12:47:49.121 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout:======================================================================================= 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout:Install 148 Packages 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 4 Packages 2024-04-25T12:47:49.122 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:47:49.123 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 222 M 2024-04-25T12:47:49.123 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2024-04-25T12:47:49.204 INFO:teuthology.orchestra.run.smithi157.stdout:(4/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 4.8 MB/s | 2.4 MB 00:00 2024-04-25T12:47:49.312 INFO:teuthology.orchestra.run.smithi157.stdout:(5/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 4.5 MB/s | 5.4 MB 00:01 2024-04-25T12:47:49.537 INFO:teuthology.orchestra.run.smithi157.stdout:(6/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 4.5 MB/s | 1.5 MB 00:00 2024-04-25T12:47:49.804 INFO:teuthology.orchestra.run.smithi157.stdout:(7/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 13 MB/s | 21 MB 00:01 2024-04-25T12:47:49.988 INFO:teuthology.orchestra.run.smithi157.stdout:(8/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 7.0 MB/s | 4.7 MB 00:00 2024-04-25T12:47:50.042 INFO:teuthology.orchestra.run.smithi132.stdout:(1/152): ceph-19.0.0-3156.gd69f13d8.el7.x86_64. 25 kB/s | 6.6 kB 00:00 2024-04-25T12:47:50.088 INFO:teuthology.orchestra.run.smithi157.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 251 kB/s | 25 kB 00:00 2024-04-25T12:47:50.522 INFO:teuthology.orchestra.run.smithi157.stdout:(10/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 15 MB/s | 11 MB 00:00 2024-04-25T12:47:50.580 INFO:teuthology.orchestra.run.smithi157.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 3.8 MB/s | 225 kB 00:00 2024-04-25T12:47:50.630 INFO:teuthology.orchestra.run.smithi157.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 540 kB/s | 27 kB 00:00 2024-04-25T12:47:50.680 INFO:teuthology.orchestra.run.smithi157.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 634 kB/s | 32 kB 00:00 2024-04-25T12:47:50.764 INFO:teuthology.orchestra.run.smithi157.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 8.8 MB/s | 747 kB 00:00 2024-04-25T12:47:50.831 INFO:teuthology.orchestra.run.smithi157.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 2.4 MB/s | 163 kB 00:00 2024-04-25T12:47:50.904 INFO:teuthology.orchestra.run.smithi157.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 1.7 MB/s | 126 kB 00:00 2024-04-25T12:47:50.942 INFO:teuthology.orchestra.run.smithi132.stdout:(2/152): ceph-fuse-19.0.0-3156.gd69f13d8.el7.x8 989 kB/s | 890 kB 00:00 2024-04-25T12:47:50.990 INFO:teuthology.orchestra.run.smithi157.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 5.7 MB/s | 500 kB 00:00 2024-04-25T12:47:51.168 INFO:teuthology.orchestra.run.smithi132.stdout:(3/152): ceph-immutable-object-cache-19.0.0-315 643 kB/s | 145 kB 00:00 2024-04-25T12:47:51.474 INFO:teuthology.orchestra.run.smithi157.stdout:(18/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 11 MB/s | 5.4 MB 00:00 2024-04-25T12:47:51.524 INFO:teuthology.orchestra.run.smithi157.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 902 kB/s | 45 kB 00:00 2024-04-25T12:47:51.591 INFO:teuthology.orchestra.run.smithi157.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 2.0 MB/s | 135 kB 00:00 2024-04-25T12:47:51.658 INFO:teuthology.orchestra.run.smithi157.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 2.4 MB/s | 161 kB 00:00 2024-04-25T12:47:51.733 INFO:teuthology.orchestra.run.smithi157.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 4.2 MB/s | 320 kB 00:00 2024-04-25T12:47:51.810 INFO:teuthology.orchestra.run.smithi132.stdout:(4/152): ceph-base-19.0.0-3156.gd69f13d8.el7.x8 2.6 MB/s | 5.4 MB 00:02 2024-04-25T12:47:51.834 INFO:teuthology.orchestra.run.smithi157.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 2.9 MB/s | 298 kB 00:00 2024-04-25T12:47:51.892 INFO:teuthology.orchestra.run.smithi157.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 1.7 MB/s | 99 kB 00:00 2024-04-25T12:47:51.959 INFO:teuthology.orchestra.run.smithi157.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.2 MB/s | 85 kB 00:00 2024-04-25T12:47:52.118 INFO:teuthology.orchestra.run.smithi132.stdout:(5/152): ceph-mgr-19.0.0-3156.gd69f13d8.el7.x86 4.8 MB/s | 1.5 MB 00:00 2024-04-25T12:47:52.376 INFO:teuthology.orchestra.run.smithi157.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 7.4 MB/s | 3.1 MB 00:00 2024-04-25T12:47:52.510 INFO:teuthology.orchestra.run.smithi157.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 1.3 MB/s | 170 kB 00:00 2024-04-25T12:47:52.586 INFO:teuthology.orchestra.run.smithi157.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 454 kB/s | 34 kB 00:00 2024-04-25T12:47:52.719 INFO:teuthology.orchestra.run.smithi157.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.0 MB/s | 142 kB 00:00 2024-04-25T12:47:52.868 INFO:teuthology.orchestra.run.smithi132.stdout:(6/152): ceph-mon-19.0.0-3156.gd69f13d8.el7.x86 6.3 MB/s | 4.7 MB 00:00 2024-04-25T12:47:52.953 INFO:teuthology.orchestra.run.smithi157.stdout:(30/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 4.9 MB/s | 17 MB 00:03 2024-04-25T12:47:52.960 INFO:teuthology.orchestra.run.smithi132.stdout:(7/152): ceph-mds-19.0.0-3156.gd69f13d8.el7.x86 1.3 MB/s | 2.4 MB 00:01 2024-04-25T12:47:53.936 INFO:teuthology.orchestra.run.smithi132.stdout:(8/152): ceph-common-19.0.0-3156.gd69f13d8.el7. 5.1 MB/s | 21 MB 00:04 2024-04-25T12:47:53.953 INFO:teuthology.orchestra.run.smithi157.stdout:(31/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 2.9 MB/s | 3.5 MB 00:01 2024-04-25T12:47:54.011 INFO:teuthology.orchestra.run.smithi132.stdout:(9/152): ceph-selinux-19.0.0-3156.gd69f13d8.el7 336 kB/s | 25 kB 00:00 2024-04-25T12:47:54.044 INFO:teuthology.orchestra.run.smithi157.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 2.7 MB/s | 249 kB 00:00 2024-04-25T12:47:54.128 INFO:teuthology.orchestra.run.smithi157.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 591 kB/s | 49 kB 00:00 2024-04-25T12:47:54.229 INFO:teuthology.orchestra.run.smithi157.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 165 kB/s | 16 kB 00:00 2024-04-25T12:47:54.487 INFO:teuthology.orchestra.run.smithi157.stdout:(35/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 1.0 MB/s | 273 kB 00:00 2024-04-25T12:47:54.569 INFO:teuthology.orchestra.run.smithi132.stdout:(10/152): ceph-osd-19.0.0-3156.gd69f13d8.el7.x8 9.9 MB/s | 17 MB 00:01 2024-04-25T12:47:54.636 INFO:teuthology.orchestra.run.smithi132.stdout:(11/152): cephfs-mirror-19.0.0-3156.gd69f13d8.e 3.3 MB/s | 225 kB 00:00 2024-04-25T12:47:54.637 INFO:teuthology.orchestra.run.smithi157.stdout:(36/152): ceph-mgr-diskprediction-local-19.0.0- 4.4 MB/s | 7.4 MB 00:01 2024-04-25T12:47:54.696 INFO:teuthology.orchestra.run.smithi157.stdout:(37/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 3.6 MB/s | 762 kB 00:00 2024-04-25T12:47:54.704 INFO:teuthology.orchestra.run.smithi132.stdout:(12/152): cephfs-shell-19.0.0-3156.gd69f13d8.el 402 kB/s | 27 kB 00:00 2024-04-25T12:47:54.721 INFO:teuthology.orchestra.run.smithi157.stdout:(38/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 218 kB/s | 18 kB 00:00 2024-04-25T12:47:54.762 INFO:teuthology.orchestra.run.smithi132.stdout:(13/152): libcephfs-devel-19.0.0-3156.gd69f13d8 542 kB/s | 32 kB 00:00 2024-04-25T12:47:54.838 INFO:teuthology.orchestra.run.smithi157.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 566 kB/s | 80 kB 00:00 2024-04-25T12:47:54.863 INFO:teuthology.orchestra.run.smithi132.stdout:(14/152): libcephfs2-19.0.0-3156.gd69f13d8.el7. 7.3 MB/s | 747 kB 00:00 2024-04-25T12:47:54.897 INFO:teuthology.orchestra.run.smithi157.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 4.5 MB/s | 803 kB 00:00 2024-04-25T12:47:54.922 INFO:teuthology.orchestra.run.smithi157.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-25T12:47:54.938 INFO:teuthology.orchestra.run.smithi132.stdout:(15/152): libcephsqlite-19.0.0-3156.gd69f13d8.e 2.1 MB/s | 163 kB 00:00 2024-04-25T12:47:54.947 INFO:teuthology.orchestra.run.smithi157.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.9 MB/s | 253 kB 00:00 2024-04-25T12:47:54.998 INFO:teuthology.orchestra.run.smithi157.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-04-25T12:47:55.005 INFO:teuthology.orchestra.run.smithi132.stdout:(16/152): librados-devel-19.0.0-3156.gd69f13d8. 1.9 MB/s | 126 kB 00:00 2024-04-25T12:47:55.023 INFO:teuthology.orchestra.run.smithi157.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 106 kB 00:00 2024-04-25T12:47:55.048 INFO:teuthology.orchestra.run.smithi157.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T12:47:55.073 INFO:teuthology.orchestra.run.smithi157.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-04-25T12:47:55.097 INFO:teuthology.orchestra.run.smithi132.stdout:(17/152): libradosstriper1-19.0.0-3156.gd69f13d 5.3 MB/s | 500 kB 00:00 2024-04-25T12:47:55.099 INFO:teuthology.orchestra.run.smithi157.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-04-25T12:47:55.124 INFO:teuthology.orchestra.run.smithi157.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 13 MB/s | 689 kB 00:00 2024-04-25T12:47:55.168 INFO:teuthology.orchestra.run.smithi157.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 943 kB 00:00 2024-04-25T12:47:55.194 INFO:teuthology.orchestra.run.smithi157.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.5 MB/s | 107 kB 00:00 2024-04-25T12:47:55.219 INFO:teuthology.orchestra.run.smithi157.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 428 kB/s | 21 kB 00:00 2024-04-25T12:47:55.244 INFO:teuthology.orchestra.run.smithi157.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T12:47:55.269 INFO:teuthology.orchestra.run.smithi157.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 659 kB/s | 33 kB 00:00 2024-04-25T12:47:55.361 INFO:teuthology.orchestra.run.smithi157.stdout:(54/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 26 MB/s | 3.0 MB 00:00 2024-04-25T12:47:55.386 INFO:teuthology.orchestra.run.smithi157.stdout:(55/152): flexiblas-openblas-openmp-3.0.4-8.el9 158 kB/s | 18 kB 00:00 2024-04-25T12:47:55.420 INFO:teuthology.orchestra.run.smithi157.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 334 kB/s | 11 kB 00:00 2024-04-25T12:47:55.445 INFO:teuthology.orchestra.run.smithi157.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-04-25T12:47:55.471 INFO:teuthology.orchestra.run.smithi157.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-04-25T12:47:55.504 INFO:teuthology.orchestra.run.smithi157.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 662 kB 00:00 2024-04-25T12:47:55.529 INFO:teuthology.orchestra.run.smithi157.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 9.9 MB/s | 582 kB 00:00 2024-04-25T12:47:55.539 INFO:teuthology.orchestra.run.smithi132.stdout:(18/152): librgw2-19.0.0-3156.gd69f13d8.el7.x86 12 MB/s | 5.4 MB 00:00 2024-04-25T12:47:55.546 INFO:teuthology.orchestra.run.smithi157.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 621 kB/s | 25 kB 00:00 2024-04-25T12:47:55.564 INFO:teuthology.orchestra.run.smithi157.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T12:47:55.589 INFO:teuthology.orchestra.run.smithi157.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-04-25T12:47:55.597 INFO:teuthology.orchestra.run.smithi132.stdout:(19/152): python3-ceph-argparse-19.0.0-3156.gd6 774 kB/s | 45 kB 00:00 2024-04-25T12:47:55.614 INFO:teuthology.orchestra.run.smithi157.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T12:47:55.631 INFO:teuthology.orchestra.run.smithi157.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 848 kB/s | 35 kB 00:00 2024-04-25T12:47:55.706 INFO:teuthology.orchestra.run.smithi132.stdout:(20/152): python3-ceph-common-19.0.0-3156.gd69f 1.2 MB/s | 135 kB 00:00 2024-04-25T12:47:55.740 INFO:teuthology.orchestra.run.smithi157.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 38 MB/s | 4.7 MB 00:00 2024-04-25T12:47:55.781 INFO:teuthology.orchestra.run.smithi132.stdout:(21/152): python3-cephfs-19.0.0-3156.gd69f13d8. 2.1 MB/s | 161 kB 00:00 2024-04-25T12:47:55.815 INFO:teuthology.orchestra.run.smithi157.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-04-25T12:47:55.857 INFO:teuthology.orchestra.run.smithi157.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-04-25T12:47:55.865 INFO:teuthology.orchestra.run.smithi132.stdout:(22/152): python3-rados-19.0.0-3156.gd69f13d8.e 3.8 MB/s | 320 kB 00:00 2024-04-25T12:47:55.901 INFO:teuthology.orchestra.run.smithi157.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-04-25T12:47:55.924 INFO:teuthology.orchestra.run.smithi157.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.0 MB/s | 133 kB 00:00 2024-04-25T12:47:55.965 INFO:teuthology.orchestra.run.smithi132.stdout:(23/152): python3-rbd-19.0.0-3156.gd69f13d8.el7 2.9 MB/s | 298 kB 00:00 2024-04-25T12:47:56.032 INFO:teuthology.orchestra.run.smithi132.stdout:(24/152): python3-rgw-19.0.0-3156.gd69f13d8.el7 1.5 MB/s | 99 kB 00:00 2024-04-25T12:47:56.066 INFO:teuthology.orchestra.run.smithi157.stdout:(71/152): postgresql-server-13.14-1.el9.x86_64. 35 MB/s | 5.8 MB 00:00 2024-04-25T12:47:56.100 INFO:teuthology.orchestra.run.smithi157.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-04-25T12:47:56.107 INFO:teuthology.orchestra.run.smithi132.stdout:(25/152): rbd-fuse-19.0.0-3156.gd69f13d8.el7.x8 1.1 MB/s | 85 kB 00:00 2024-04-25T12:47:56.125 INFO:teuthology.orchestra.run.smithi157.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T12:47:56.309 INFO:teuthology.orchestra.run.smithi157.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 29 MB/s | 6.0 MB 00:00 2024-04-25T12:47:56.334 INFO:teuthology.orchestra.run.smithi157.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.1 MB/s | 244 kB 00:00 2024-04-25T12:47:56.359 INFO:teuthology.orchestra.run.smithi157.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T12:47:56.384 INFO:teuthology.orchestra.run.smithi157.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 515 kB/s | 26 kB 00:00 2024-04-25T12:47:56.399 INFO:teuthology.orchestra.run.smithi132.stdout:(26/152): rbd-mirror-19.0.0-3156.gd69f13d8.el7. 11 MB/s | 3.1 MB 00:00 2024-04-25T12:47:56.410 INFO:teuthology.orchestra.run.smithi157.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 378 kB/s | 19 kB 00:00 2024-04-25T12:47:56.435 INFO:teuthology.orchestra.run.smithi157.stdout:(79/152): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-04-25T12:47:56.460 INFO:teuthology.orchestra.run.smithi157.stdout:(80/152): python3-markupsafe-1.1.1-12.el9.x86_6 700 kB/s | 35 kB 00:00 2024-04-25T12:47:56.467 INFO:teuthology.orchestra.run.smithi132.stdout:(27/152): rbd-nbd-19.0.0-3156.gd69f13d8.el7.x86 2.5 MB/s | 170 kB 00:00 2024-04-25T12:47:56.567 INFO:teuthology.orchestra.run.smithi132.stdout:(28/152): ceph-grafana-dashboards-19.0.0-3156.g 342 kB/s | 34 kB 00:00 2024-04-25T12:47:56.628 INFO:teuthology.orchestra.run.smithi157.stdout:(81/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 5.1 MB 00:00 2024-04-25T12:47:56.650 INFO:teuthology.orchestra.run.smithi132.stdout:(29/152): ceph-mgr-cephadm-19.0.0-3156.gd69f13d 1.7 MB/s | 142 kB 00:00 2024-04-25T12:47:56.653 INFO:teuthology.orchestra.run.smithi157.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 250 kB 00:00 2024-04-25T12:47:56.686 INFO:teuthology.orchestra.run.smithi157.stdout:(83/152): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-04-25T12:47:56.712 INFO:teuthology.orchestra.run.smithi157.stdout:(84/152): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-25T12:47:56.745 INFO:teuthology.orchestra.run.smithi157.stdout:(85/152): python3-prettytable-0.7.2-27.el9.noar 726 kB/s | 42 kB 00:00 2024-04-25T12:47:56.779 INFO:teuthology.orchestra.run.smithi157.stdout:(86/152): python3-protobuf-3.14.0-13.el9.noarch 3.9 MB/s | 269 kB 00:00 2024-04-25T12:47:56.804 INFO:teuthology.orchestra.run.smithi157.stdout:(87/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-04-25T12:47:56.846 INFO:teuthology.orchestra.run.smithi157.stdout:(88/152): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-04-25T12:47:56.871 INFO:teuthology.orchestra.run.smithi157.stdout:(89/152): python3-pytz-2021.1-5.el9.noarch.rpm 761 kB/s | 51 kB 00:00 2024-04-25T12:47:56.913 INFO:teuthology.orchestra.run.smithi157.stdout:(90/152): python3-requests-oauthlib-1.3.0-12.el 803 kB/s | 54 kB 00:00 2024-04-25T12:47:57.009 INFO:teuthology.orchestra.run.smithi132.stdout:(30/152): ceph-mgr-dashboard-19.0.0-3156.gd69f1 9.9 MB/s | 3.5 MB 00:00 2024-04-25T12:47:57.180 INFO:teuthology.orchestra.run.smithi157.stdout:(91/152): python3-toml-0.10.2-6.el9.noarch.rpm 156 kB/s | 42 kB 00:00 2024-04-25T12:47:57.409 INFO:teuthology.orchestra.run.smithi132.stdout:(31/152): ceph-radosgw-19.0.0-3156.gd69f13d8.el 2.4 MB/s | 11 MB 00:04 2024-04-25T12:47:57.510 INFO:teuthology.orchestra.run.smithi132.stdout:(32/152): ceph-mgr-modules-core-19.0.0-3156.gd6 2.4 MB/s | 249 kB 00:00 2024-04-25T12:47:57.556 INFO:teuthology.orchestra.run.smithi157.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 24 MB/s | 16 MB 00:00 2024-04-25T12:47:57.560 INFO:teuthology.orchestra.run.smithi132.stdout:(33/152): ceph-mgr-rook-19.0.0-3156.gd69f13d8.e 990 kB/s | 49 kB 00:00 2024-04-25T12:47:57.580 INFO:teuthology.orchestra.run.smithi157.stdout:(93/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 111 kB/s | 44 kB 00:00 2024-04-25T12:47:57.602 INFO:teuthology.orchestra.run.smithi132.stdout:(34/152): ceph-prometheus-alerts-19.0.0-3156.gd 393 kB/s | 16 kB 00:00 2024-04-25T12:47:57.622 INFO:teuthology.orchestra.run.smithi157.stdout:(94/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-25T12:47:57.648 INFO:teuthology.orchestra.run.smithi157.stdout:(95/152): qatlib-service-24.02.0-1.el9.x86_64.r 535 kB/s | 36 kB 00:00 2024-04-25T12:47:57.673 INFO:teuthology.orchestra.run.smithi157.stdout:(96/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-04-25T12:47:57.694 INFO:teuthology.orchestra.run.smithi132.stdout:(35/152): ceph-mgr-diskprediction-local-19.0.0- 11 MB/s | 7.4 MB 00:00 2024-04-25T12:47:57.715 INFO:teuthology.orchestra.run.smithi157.stdout:(97/152): socat-1.7.4.1-5.el9.x86_64.rpm 4.4 MB/s | 305 kB 00:00 2024-04-25T12:47:57.732 INFO:teuthology.orchestra.run.smithi157.stdout:(98/152): uuid-1.6.2-55.el9.x86_64.rpm 986 kB/s | 58 kB 00:00 2024-04-25T12:47:57.752 INFO:teuthology.orchestra.run.smithi132.stdout:(36/152): ceph-volume-19.0.0-3156.gd69f13d8.el7 1.8 MB/s | 273 kB 00:00 2024-04-25T12:47:57.774 INFO:teuthology.orchestra.run.smithi157.stdout:(99/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-04-25T12:47:57.791 INFO:teuthology.orchestra.run.smithi157.stdout:(100/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T12:47:57.803 INFO:teuthology.orchestra.run.smithi132.stdout:(37/152): cephfs-top-19.0.0-3156.gd69f13d8.el7. 364 kB/s | 18 kB 00:00 2024-04-25T12:47:57.825 INFO:teuthology.orchestra.run.smithi157.stdout:(101/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 893 kB/s | 45 kB 00:00 2024-04-25T12:47:57.828 INFO:teuthology.orchestra.run.smithi132.stdout:(38/152): cephadm-19.0.0-3156.gd69f13d8.el7.noa 5.6 MB/s | 762 kB 00:00 2024-04-25T12:47:57.850 INFO:teuthology.orchestra.run.smithi157.stdout:(102/152): lua-devel-5.4.4-4.el9.x86_64.rpm 380 kB/s | 22 kB 00:00 2024-04-25T12:47:57.908 INFO:teuthology.orchestra.run.smithi157.stdout:(103/152): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-04-25T12:47:57.970 INFO:teuthology.orchestra.run.smithi132.stdout:(39/152): fuse-2.9.9-15.el9.x86_64.rpm 482 kB/s | 80 kB 00:00 2024-04-25T12:47:58.062 INFO:teuthology.orchestra.run.smithi132.stdout:(40/152): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-04-25T12:47:58.087 INFO:teuthology.orchestra.run.smithi132.stdout:(41/152): libquadmath-11.4.1-3.el9.x86_64.rpm 1.6 MB/s | 195 kB 00:00 2024-04-25T12:47:58.137 INFO:teuthology.orchestra.run.smithi132.stdout:(42/152): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-04-25T12:47:58.238 INFO:teuthology.orchestra.run.smithi132.stdout:(43/152): python3-cryptography-36.0.1-4.el9.x86 8.2 MB/s | 1.2 MB 00:00 2024-04-25T12:47:58.263 INFO:teuthology.orchestra.run.smithi132.stdout:(44/152): python3-ply-3.11-14.el9.noarch.rpm 851 kB/s | 106 kB 00:00 2024-04-25T12:47:58.289 INFO:teuthology.orchestra.run.smithi132.stdout:(45/152): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-04-25T12:47:58.322 INFO:teuthology.orchestra.run.smithi132.stdout:(46/152): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-04-25T12:47:58.347 INFO:teuthology.orchestra.run.smithi132.stdout:(47/152): python3-urllib3-1.26.5-5.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-04-25T12:47:58.389 INFO:teuthology.orchestra.run.smithi132.stdout:(48/152): automake-1.16.2-8.el9.noarch.rpm 10 MB/s | 689 kB 00:00 2024-04-25T12:47:58.409 INFO:teuthology.orchestra.run.smithi157.stdout:(104/152): abseil-cpp-20211102.0-3.el9.x86_64.r 981 kB/s | 548 kB 00:00 2024-04-25T12:47:58.423 INFO:teuthology.orchestra.run.smithi132.stdout:(49/152): bison-3.7.4-5.el9.x86_64.rpm 12 MB/s | 943 kB 00:00 2024-04-25T12:47:58.434 INFO:teuthology.orchestra.run.smithi157.stdout:(105/152): gperftools-libs-2.9.1-2.el9.x86_64.r 588 kB/s | 309 kB 00:00 2024-04-25T12:47:58.448 INFO:teuthology.orchestra.run.smithi132.stdout:(50/152): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-04-25T12:47:58.473 INFO:teuthology.orchestra.run.smithi132.stdout:(51/152): elfutils-libelf-devel-0.190-2.el9.x86 430 kB/s | 21 kB 00:00 2024-04-25T12:47:58.484 INFO:teuthology.orchestra.run.smithi157.stdout:(106/152): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-04-25T12:47:58.499 INFO:teuthology.orchestra.run.smithi132.stdout:(52/152): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 313 kB 00:00 2024-04-25T12:47:58.524 INFO:teuthology.orchestra.run.smithi132.stdout:(53/152): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-04-25T12:47:58.601 INFO:teuthology.orchestra.run.smithi157.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 222 kB/s | 26 kB 00:00 2024-04-25T12:47:58.693 INFO:teuthology.orchestra.run.smithi157.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 529 kB/s | 49 kB 00:00 2024-04-25T12:47:58.716 INFO:teuthology.orchestra.run.smithi132.stdout:(54/152): flexiblas-openblas-openmp-3.0.4-8.el9 95 kB/s | 18 kB 00:00 2024-04-25T12:47:58.769 INFO:teuthology.orchestra.run.smithi157.stdout:(109/152): libunwind-1.6.2-1.el9.x86_64.rpm 898 kB/s | 67 kB 00:00 2024-04-25T12:47:58.775 INFO:teuthology.orchestra.run.smithi132.stdout:(55/152): flexiblas-netlib-3.0.4-8.el9.x86_64.r 11 MB/s | 3.0 MB 00:00 2024-04-25T12:47:58.801 INFO:teuthology.orchestra.run.smithi132.stdout:(56/152): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-04-25T12:47:58.825 INFO:teuthology.orchestra.run.smithi132.stdout:(57/152): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-04-25T12:47:58.842 INFO:teuthology.orchestra.run.smithi132.stdout:(58/152): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-04-25T12:47:58.861 INFO:teuthology.orchestra.run.smithi157.stdout:(110/152): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-25T12:47:58.901 INFO:teuthology.orchestra.run.smithi132.stdout:(59/152): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-04-25T12:47:58.926 INFO:teuthology.orchestra.run.smithi132.stdout:(60/152): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 582 kB 00:00 2024-04-25T12:47:58.927 INFO:teuthology.orchestra.run.smithi157.stdout:(111/152): libarrow-9.0.0-10.el9.x86_64.rpm 9.0 MB/s | 4.4 MB 00:00 2024-04-25T12:47:58.943 INFO:teuthology.orchestra.run.smithi132.stdout:(61/152): libuuid-devel-2.37.4-18.el9.x86_64.rp 618 kB/s | 25 kB 00:00 2024-04-25T12:47:58.960 INFO:teuthology.orchestra.run.smithi132.stdout:(62/152): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 47 kB 00:00 2024-04-25T12:47:58.986 INFO:teuthology.orchestra.run.smithi132.stdout:(63/152): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 292 kB 00:00 2024-04-25T12:47:59.011 INFO:teuthology.orchestra.run.smithi132.stdout:(64/152): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-04-25T12:47:59.011 INFO:teuthology.orchestra.run.smithi157.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-04-25T12:47:59.036 INFO:teuthology.orchestra.run.smithi132.stdout:(65/152): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-04-25T12:47:59.037 INFO:teuthology.orchestra.run.smithi157.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.7 MB/s | 838 kB 00:00 2024-04-25T12:47:59.103 INFO:teuthology.orchestra.run.smithi157.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 473 kB/s | 43 kB 00:00 2024-04-25T12:47:59.129 INFO:teuthology.orchestra.run.smithi157.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 349 kB/s | 32 kB 00:00 2024-04-25T12:47:59.153 INFO:teuthology.orchestra.run.smithi132.stdout:(66/152): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2024-04-25T12:47:59.179 INFO:teuthology.orchestra.run.smithi157.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-04-25T12:47:59.212 INFO:teuthology.orchestra.run.smithi157.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-04-25T12:47:59.237 INFO:teuthology.orchestra.run.smithi132.stdout:(67/152): openssl-devel-3.2.1-1.el9.x86_64.rpm 22 MB/s | 4.4 MB 00:00 2024-04-25T12:47:59.254 INFO:teuthology.orchestra.run.smithi157.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 4.7 MB/s | 358 kB 00:00 2024-04-25T12:47:59.279 INFO:teuthology.orchestra.run.smithi132.stdout:(68/152): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-25T12:47:59.296 INFO:teuthology.orchestra.run.smithi157.stdout:(119/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-04-25T12:47:59.312 INFO:teuthology.orchestra.run.smithi132.stdout:(69/152): postgresql-contrib-13.14-1.el9.x86_64 12 MB/s | 911 kB 00:00 2024-04-25T12:47:59.322 INFO:teuthology.orchestra.run.smithi157.stdout:(120/152): python3-colorama-0.4.4-12.el9.noarch 528 kB/s | 35 kB 00:00 2024-04-25T12:47:59.338 INFO:teuthology.orchestra.run.smithi132.stdout:(70/152): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-04-25T12:47:59.397 INFO:teuthology.orchestra.run.smithi157.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 2.0 MB/s | 206 kB 00:00 2024-04-25T12:47:59.497 INFO:teuthology.orchestra.run.smithi157.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 1.4 MB/s | 144 kB 00:00 2024-04-25T12:47:59.546 INFO:teuthology.orchestra.run.smithi132.stdout:(71/152): postgresql-server-13.14-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-04-25T12:47:59.564 INFO:teuthology.orchestra.run.smithi157.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 160 kB/s | 11 kB 00:00 2024-04-25T12:47:59.580 INFO:teuthology.orchestra.run.smithi132.stdout:(72/152): protobuf-3.14.0-13.el9.x86_64.rpm 4.2 MB/s | 1.0 MB 00:00 2024-04-25T12:47:59.605 INFO:teuthology.orchestra.run.smithi132.stdout:(73/152): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-04-25T12:47:59.606 INFO:teuthology.orchestra.run.smithi157.stdout:(124/152): python3-grpcio-1.46.7-10.el9.x86_64. 7.2 MB/s | 2.0 MB 00:00 2024-04-25T12:47:59.640 INFO:teuthology.orchestra.run.smithi157.stdout:(125/152): python3-jaraco-classes-3.2.1-5.el9.n 235 kB/s | 18 kB 00:00 2024-04-25T12:47:59.698 INFO:teuthology.orchestra.run.smithi157.stdout:(126/152): python3-jaraco-collections-3.0.0-8.e 251 kB/s | 23 kB 00:00 2024-04-25T12:47:59.723 INFO:teuthology.orchestra.run.smithi157.stdout:(127/152): python3-jaraco-functools-3.5.0-2.el9 232 kB/s | 19 kB 00:00 2024-04-25T12:47:59.766 INFO:teuthology.orchestra.run.smithi157.stdout:(128/152): python3-jaraco-text-3.2.0-6.el9.noar 294 kB/s | 20 kB 00:00 2024-04-25T12:47:59.772 INFO:teuthology.orchestra.run.smithi132.stdout:(74/152): python3-babel-2.9.1-2.el9.noarch.rpm 31 MB/s | 6.0 MB 00:00 2024-04-25T12:47:59.798 INFO:teuthology.orchestra.run.smithi132.stdout:(75/152): python3-devel-3.9.18-3.el9.x86_64.rpm 1.3 MB/s | 244 kB 00:00 2024-04-25T12:47:59.823 INFO:teuthology.orchestra.run.smithi132.stdout:(76/152): python3-jinja2-2.11.3-5.el9.noarch.rp 4.9 MB/s | 248 kB 00:00 2024-04-25T12:47:59.841 INFO:teuthology.orchestra.run.smithi157.stdout:(129/152): python3-kubernetes-26.1.0-2.el9.noar 8.7 MB/s | 1.0 MB 00:00 2024-04-25T12:47:59.848 INFO:teuthology.orchestra.run.smithi132.stdout:(77/152): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-04-25T12:47:59.866 INFO:teuthology.orchestra.run.smithi157.stdout:(130/152): python3-logutils-0.3.5-21.el9.noarch 462 kB/s | 46 kB 00:00 2024-04-25T12:47:59.873 INFO:teuthology.orchestra.run.smithi132.stdout:(78/152): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-04-25T12:47:59.908 INFO:teuthology.orchestra.run.smithi157.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-04-25T12:47:59.934 INFO:teuthology.orchestra.run.smithi157.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 860 kB/s | 58 kB 00:00 2024-04-25T12:47:59.983 INFO:teuthology.orchestra.run.smithi157.stdout:(133/152): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-04-25T12:48:00.009 INFO:teuthology.orchestra.run.smithi157.stdout:(134/152): python3-portend-3.1.0-2.el9.noarch.r 219 kB/s | 16 kB 00:00 2024-04-25T12:48:00.051 INFO:teuthology.orchestra.run.smithi157.stdout:(135/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-04-25T12:48:00.076 INFO:teuthology.orchestra.run.smithi157.stdout:(136/152): python3-pyperclip-1.8.2-2.el9.noarch 420 kB/s | 28 kB 00:00 2024-04-25T12:48:00.118 INFO:teuthology.orchestra.run.smithi157.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 460 kB/s | 31 kB 00:00 2024-04-25T12:48:00.152 INFO:teuthology.orchestra.run.smithi157.stdout:(138/152): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-04-25T12:48:00.186 INFO:teuthology.orchestra.run.smithi157.stdout:(139/152): python3-rsa-4.9-2.el9.noarch.rpm 880 kB/s | 59 kB 00:00 2024-04-25T12:48:00.227 INFO:teuthology.orchestra.run.smithi157.stdout:(140/152): python3-tempora-5.0.0-2.el9.noarch.r 477 kB/s | 36 kB 00:00 2024-04-25T12:48:00.252 INFO:teuthology.orchestra.run.smithi157.stdout:(141/152): python3-typing-extensions-4.4.0-2.el 763 kB/s | 51 kB 00:00 2024-04-25T12:48:00.303 INFO:teuthology.orchestra.run.smithi157.stdout:(142/152): python3-webob-1.8.7-6.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-04-25T12:48:00.315 INFO:teuthology.orchestra.run.smithi132.stdout:(79/152): ceph-test-19.0.0-3156.gd69f13d8.el7.x 7.8 MB/s | 49 MB 00:06 2024-04-25T12:48:00.328 INFO:teuthology.orchestra.run.smithi157.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-25T12:48:00.341 INFO:teuthology.orchestra.run.smithi132.stdout:(80/152): python3-mako-1.1.4-6.el9.noarch.rpm 350 kB/s | 172 kB 00:00 2024-04-25T12:48:00.366 INFO:teuthology.orchestra.run.smithi132.stdout:(81/152): python3-markupsafe-1.1.1-12.el9.x86_6 71 kB/s | 35 kB 00:00 2024-04-25T12:48:00.378 INFO:teuthology.orchestra.run.smithi157.stdout:(144/152): python3-werkzeug-2.0.3-3.el9.1.noarc 5.6 MB/s | 427 kB 00:00 2024-04-25T12:48:00.403 INFO:teuthology.orchestra.run.smithi157.stdout:(145/152): python3-zc-lockfile-2.0-10.el9.noarc 265 kB/s | 20 kB 00:00 2024-04-25T12:48:00.425 INFO:teuthology.orchestra.run.smithi132.stdout:(82/152): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-04-25T12:48:00.462 INFO:teuthology.orchestra.run.smithi157.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-04-25T12:48:00.500 INFO:teuthology.orchestra.run.smithi132.stdout:(83/152): python3-numpy-1.20.1-5.el9.x86_64.rpm 32 MB/s | 5.1 MB 00:00 2024-04-25T12:48:00.525 INFO:teuthology.orchestra.run.smithi132.stdout:(84/152): python3-oauthlib-3.1.1-5.el9.noarch.r 1.4 MB/s | 222 kB 00:00 2024-04-25T12:48:00.537 INFO:teuthology.orchestra.run.smithi157.stdout:(147/152): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-25T12:48:00.551 INFO:teuthology.orchestra.run.smithi132.stdout:(85/152): python3-packaging-20.9-5.el9.noarch.r 629 kB/s | 77 kB 00:00 2024-04-25T12:48:00.576 INFO:teuthology.orchestra.run.smithi132.stdout:(86/152): python3-prettytable-0.7.2-27.el9.noar 566 kB/s | 42 kB 00:00 2024-04-25T12:48:00.601 INFO:teuthology.orchestra.run.smithi132.stdout:(87/152): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-04-25T12:48:00.626 INFO:teuthology.orchestra.run.smithi132.stdout:(88/152): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-04-25T12:48:00.652 INFO:teuthology.orchestra.run.smithi132.stdout:(89/152): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-04-25T12:48:00.677 INFO:teuthology.orchestra.run.smithi132.stdout:(90/152): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-04-25T12:48:00.702 INFO:teuthology.orchestra.run.smithi132.stdout:(91/152): python3-requests-oauthlib-1.3.0-12.el 718 kB/s | 54 kB 00:00 2024-04-25T12:48:01.011 INFO:teuthology.orchestra.run.smithi132.stdout:(92/152): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-04-25T12:48:01.030 INFO:teuthology.orchestra.run.smithi157.stdout:(148/152): ceph-test-19.0.0-3156.gd69f13d8.el7. 4.5 MB/s | 49 MB 00:10 2024-04-25T12:48:01.036 INFO:teuthology.orchestra.run.smithi132.stdout:(93/152): python3-toml-0.10.2-6.el9.noarch.rpm 126 kB/s | 42 kB 00:00 2024-04-25T12:48:01.061 INFO:teuthology.orchestra.run.smithi132.stdout:(94/152): python3-wcwidth-0.2.5-8.el9.noarch.rp 124 kB/s | 44 kB 00:00 2024-04-25T12:48:01.078 INFO:teuthology.orchestra.run.smithi132.stdout:(95/152): qatlib-24.02.0-1.el9.x86_64.rpm 3.2 MB/s | 221 kB 00:00 2024-04-25T12:48:01.095 INFO:teuthology.orchestra.run.smithi132.stdout:(96/152): qatlib-service-24.02.0-1.el9.x86_64.r 1.1 MB/s | 36 kB 00:00 2024-04-25T12:48:01.105 INFO:teuthology.orchestra.run.smithi157.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 18 MB/s | 1.3 MB 00:00 2024-04-25T12:48:01.111 INFO:teuthology.orchestra.run.smithi132.stdout:(97/152): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-04-25T12:48:01.137 INFO:teuthology.orchestra.run.smithi132.stdout:(98/152): socat-1.7.4.1-5.el9.x86_64.rpm 5.1 MB/s | 305 kB 00:00 2024-04-25T12:48:01.154 INFO:teuthology.orchestra.run.smithi132.stdout:(99/152): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-04-25T12:48:01.179 INFO:teuthology.orchestra.run.smithi132.stdout:(100/152): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.4 MB/s | 94 kB 00:00 2024-04-25T12:48:01.196 INFO:teuthology.orchestra.run.smithi132.stdout:(101/152): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-04-25T12:48:01.205 INFO:teuthology.orchestra.run.smithi157.stdout:(150/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 24 MB/s | 2.4 MB 00:00 2024-04-25T12:48:01.213 INFO:teuthology.orchestra.run.smithi132.stdout:(102/152): zlib-devel-1.2.11-41.el9.x86_64.rpm 1.3 MB/s | 45 kB 00:00 2024-04-25T12:48:01.230 INFO:teuthology.orchestra.run.smithi132.stdout:(103/152): lua-devel-5.4.4-4.el9.x86_64.rpm 444 kB/s | 22 kB 00:00 2024-04-25T12:48:01.263 INFO:teuthology.orchestra.run.smithi132.stdout:(104/152): protobuf-compiler-3.14.0-13.el9.x86_ 13 MB/s | 863 kB 00:00 2024-04-25T12:48:01.297 INFO:teuthology.orchestra.run.smithi157.stdout:(151/152): librados2-19.0.0-3156.gd69f13d8.el7. 4.1 MB/s | 3.4 MB 00:00 2024-04-25T12:48:01.372 INFO:teuthology.orchestra.run.smithi157.stdout:(152/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 3.8 MB/s | 3.1 MB 00:00 2024-04-25T12:48:01.379 INFO:teuthology.orchestra.run.smithi157.stdout:-------------------------------------------------------------------------------- 2024-04-25T12:48:01.379 INFO:teuthology.orchestra.run.smithi157.stdout:Total 16 MB/s | 222 MB 00:13 2024-04-25T12:48:01.764 INFO:teuthology.orchestra.run.smithi132.stdout:(105/152): grpc-data-1.46.7-10.el9.noarch.rpm 39 kB/s | 19 kB 00:00 2024-04-25T12:48:02.097 INFO:teuthology.orchestra.run.smithi132.stdout:(106/152): gperftools-libs-2.9.1-2.el9.x86_64.r 357 kB/s | 309 kB 00:00 2024-04-25T12:48:02.265 INFO:teuthology.orchestra.run.smithi132.stdout:(107/152): libarrow-doc-9.0.0-10.el9.noarch.rpm 155 kB/s | 26 kB 00:00 2024-04-25T12:48:02.365 INFO:teuthology.orchestra.run.smithi132.stdout:(108/152): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2024-04-25T12:48:02.478 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction check 2024-04-25T12:48:02.515 INFO:teuthology.orchestra.run.smithi132.stdout:(109/152): abseil-cpp-20211102.0-3.el9.x86_64.r 427 kB/s | 548 kB 00:01 2024-04-25T12:48:02.565 INFO:teuthology.orchestra.run.smithi132.stdout:(110/152): libunwind-1.6.2-1.el9.x86_64.rpm 336 kB/s | 67 kB 00:00 2024-04-25T12:48:02.625 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction check succeeded. 2024-04-25T12:48:02.625 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction test 2024-04-25T12:48:02.841 INFO:teuthology.orchestra.run.smithi132.stdout:(111/152): luarocks-3.9.2-1.el9.noarch.rpm 464 kB/s | 151 kB 00:00 2024-04-25T12:48:03.699 INFO:teuthology.orchestra.run.smithi132.stdout:(112/152): python3-asyncssh-2.13.2-5.el9.noarch 639 kB/s | 548 kB 00:00 2024-04-25T12:48:03.816 INFO:teuthology.orchestra.run.smithi132.stdout:(113/152): parquet-libs-9.0.0-10.el9.x86_64.rpm 670 kB/s | 838 kB 00:01 2024-04-25T12:48:03.841 INFO:teuthology.orchestra.run.smithi132.stdout:(114/152): python3-bcrypt-3.2.2-1.el9.x86_64.rp 306 kB/s | 43 kB 00:00 2024-04-25T12:48:03.933 INFO:teuthology.orchestra.run.smithi132.stdout:(115/152): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2024-04-25T12:48:03.959 INFO:teuthology.orchestra.run.smithi132.stdout:(116/152): python3-certifi-2021.10.8-2.el9.noar 128 kB/s | 15 kB 00:00 2024-04-25T12:48:04.309 INFO:teuthology.orchestra.run.smithi132.stdout:(117/152): python3-cheroot-8.6.0-4.el9.noarch.r 458 kB/s | 172 kB 00:00 2024-04-25T12:48:04.409 INFO:teuthology.orchestra.run.smithi157.stdout:Transaction test succeeded. 2024-04-25T12:48:04.410 INFO:teuthology.orchestra.run.smithi157.stdout:Running transaction 2024-04-25T12:48:04.626 INFO:teuthology.orchestra.run.smithi132.stdout:(118/152): python3-cherrypy-18.6.1-2.el9.noarch 538 kB/s | 358 kB 00:00 2024-04-25T12:48:04.743 INFO:teuthology.orchestra.run.smithi132.stdout:(119/152): python3-colorama-0.4.4-12.el9.noarch 303 kB/s | 35 kB 00:00 2024-04-25T12:48:04.876 INFO:teuthology.orchestra.run.smithi132.stdout:(120/152): python3-cmd2-2.4.2-2.el9.noarch.rpm 534 kB/s | 303 kB 00:00 2024-04-25T12:48:05.168 INFO:teuthology.orchestra.run.smithi132.stdout:(121/152): python3-google-auth-2.29.0-1.el9.noa 484 kB/s | 206 kB 00:00 2024-04-25T12:48:05.527 INFO:teuthology.orchestra.run.smithi132.stdout:(122/152): python3-grpcio-tools-1.46.7-10.el9.x 403 kB/s | 144 kB 00:00 2024-04-25T12:48:05.661 INFO:teuthology.orchestra.run.smithi132.stdout:(123/152): python3-jaraco-8.2.1-3.el9.noarch.rp 80 kB/s | 11 kB 00:00 2024-04-25T12:48:05.778 INFO:teuthology.orchestra.run.smithi132.stdout:(124/152): python3-jaraco-classes-3.2.1-5.el9.n 152 kB/s | 18 kB 00:00 2024-04-25T12:48:05.895 INFO:teuthology.orchestra.run.smithi132.stdout:(125/152): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2024-04-25T12:48:06.003 INFO:teuthology.orchestra.run.smithi132.stdout:(126/152): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-04-25T12:48:06.112 INFO:teuthology.orchestra.run.smithi132.stdout:(127/152): python3-jaraco-text-3.2.0-6.el9.noar 181 kB/s | 20 kB 00:00 2024-04-25T12:48:07.520 INFO:teuthology.orchestra.run.smithi132.stdout:(128/152): python3-kubernetes-26.1.0-2.el9.noar 742 kB/s | 1.0 MB 00:01 2024-04-25T12:48:07.629 INFO:teuthology.orchestra.run.smithi132.stdout:(129/152): python3-logutils-0.3.5-21.el9.noarch 427 kB/s | 46 kB 00:00 2024-04-25T12:48:07.679 INFO:teuthology.orchestra.run.smithi132.stdout:(130/152): python3-grpcio-1.46.7-10.el9.x86_64. 744 kB/s | 2.0 MB 00:02 2024-04-25T12:48:07.813 INFO:teuthology.orchestra.run.smithi132.stdout:(131/152): python3-more-itertools-8.12.0-2.el9. 429 kB/s | 79 kB 00:00 2024-04-25T12:48:07.863 INFO:teuthology.orchestra.run.smithi132.stdout:(132/152): python3-natsort-7.1.1-5.el9.noarch.r 314 kB/s | 58 kB 00:00 2024-04-25T12:48:07.964 INFO:teuthology.orchestra.run.smithi132.stdout:(133/152): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2024-04-25T12:48:08.022 INFO:teuthology.orchestra.run.smithi132.stdout:(134/152): libarrow-9.0.0-10.el9.x86_64.rpm 723 kB/s | 4.4 MB 00:06 2024-04-25T12:48:08.114 INFO:teuthology.orchestra.run.smithi132.stdout:(135/152): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-04-25T12:48:08.148 INFO:teuthology.orchestra.run.smithi132.stdout:(136/152): python3-pyOpenSSL-21.0.0-1.el9.noarc 489 kB/s | 90 kB 00:00 2024-04-25T12:48:08.206 INFO:teuthology.orchestra.run.smithi132.stdout:(137/152): python3-repoze-lru-0.7-16.el9.noarch 334 kB/s | 31 kB 00:00 2024-04-25T12:48:08.282 INFO:teuthology.orchestra.run.smithi132.stdout:(138/152): python3-pecan-1.4.2-3.el9.noarch.rpm 581 kB/s | 272 kB 00:00 2024-04-25T12:48:08.374 INFO:teuthology.orchestra.run.smithi132.stdout:(139/152): python3-tempora-5.0.0-2.el9.noarch.r 390 kB/s | 36 kB 00:00 2024-04-25T12:48:08.390 INFO:teuthology.orchestra.run.smithi132.stdout:(140/152): python3-rsa-4.9-2.el9.noarch.rpm 321 kB/s | 59 kB 00:00 2024-04-25T12:48:08.408 INFO:teuthology.orchestra.run.smithi132.stdout:(141/152): python3-routes-2.5.1-5.el9.noarch.rp 726 kB/s | 188 kB 00:00 2024-04-25T12:48:08.550 INFO:teuthology.orchestra.run.smithi132.stdout:(142/152): python3-typing-extensions-4.4.0-2.el 290 kB/s | 51 kB 00:00 2024-04-25T12:48:08.608 INFO:teuthology.orchestra.run.smithi132.stdout:(143/152): python3-websocket-client-1.2.3-2.el9 447 kB/s | 90 kB 00:00 2024-04-25T12:48:08.709 INFO:teuthology.orchestra.run.smithi132.stdout:(144/152): python3-zc-lockfile-2.0-10.el9.noarc 200 kB/s | 20 kB 00:00 2024-04-25T12:48:08.734 INFO:teuthology.orchestra.run.smithi132.stdout:(145/152): python3-webob-1.8.7-6.el9.noarch.rpm 670 kB/s | 230 kB 00:00 2024-04-25T12:48:08.976 INFO:teuthology.orchestra.run.smithi132.stdout:(146/152): re2-20211101-3.el9.x86_64.rpm 718 kB/s | 192 kB 00:00 2024-04-25T12:48:09.143 INFO:teuthology.orchestra.run.smithi132.stdout:(147/152): python3-werkzeug-2.0.3-3.el9.1.noarc 721 kB/s | 427 kB 00:00 2024-04-25T12:48:09.535 INFO:teuthology.orchestra.run.smithi132.stdout:(148/152): librbd1-19.0.0-3156.gd69f13d8.el7.x8 8.0 MB/s | 3.1 MB 00:00 2024-04-25T12:48:09.601 INFO:teuthology.orchestra.run.smithi132.stdout:(149/152): openssl-3.2.1-1.el9.x86_64.rpm 20 MB/s | 1.3 MB 00:00 2024-04-25T12:48:09.694 INFO:teuthology.orchestra.run.smithi132.stdout:(150/152): librados2-19.0.0-3156.gd69f13d8.el7. 4.7 MB/s | 3.4 MB 00:00 2024-04-25T12:48:09.735 INFO:teuthology.orchestra.run.smithi132.stdout:(151/152): openssl-libs-3.2.1-1.el9.x86_64.rpm 18 MB/s | 2.4 MB 00:00 2024-04-25T12:48:10.349 INFO:teuthology.orchestra.run.smithi157.stdout: Preparing : 1/1 2024-04-25T12:48:10.425 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T12:48:10.472 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T12:48:10.593 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T12:48:10.701 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T12:48:10.727 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T12:48:10.752 INFO:teuthology.orchestra.run.smithi132.stdout:(152/152): thrift-0.15.0-2.el9.x86_64.rpm 803 kB/s | 1.6 MB 00:02 2024-04-25T12:48:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2024-04-25T12:48:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:Total 10 MB/s | 222 MB 00:21 2024-04-25T12:48:10.770 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T12:48:11.098 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T12:48:11.203 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T12:48:11.325 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T12:48:11.346 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T12:48:11.436 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T12:48:11.467 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T12:48:11.615 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T12:48:11.663 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T12:48:11.692 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T12:48:11.802 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T12:48:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2024-04-25T12:48:11.826 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T12:48:11.889 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T12:48:11.910 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T12:48:11.935 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T12:48:11.967 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2024-04-25T12:48:11.967 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2024-04-25T12:48:12.085 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T12:48:12.118 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T12:48:12.227 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T12:48:12.330 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T12:48:12.367 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T12:48:12.402 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T12:48:12.469 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T12:48:12.511 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T12:48:12.554 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T12:48:12.586 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T12:48:12.615 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T12:48:12.684 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T12:48:12.737 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T12:48:12.776 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T12:48:12.820 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T12:48:12.907 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T12:48:12.947 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T12:48:12.991 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T12:48:13.019 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T12:48:13.089 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T12:48:13.134 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T12:48:13.234 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T12:48:13.377 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T12:48:13.437 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T12:48:13.736 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2024-04-25T12:48:13.736 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2024-04-25T12:48:13.965 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T12:48:14.048 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T12:48:14.077 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T12:48:14.120 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T12:48:14.158 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T12:48:14.199 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T12:48:14.374 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T12:48:14.428 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T12:48:14.482 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T12:48:14.556 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T12:48:14.595 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T12:48:14.632 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T12:48:14.678 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T12:48:14.714 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T12:48:14.766 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T12:48:14.808 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T12:48:14.944 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T12:48:14.997 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T12:48:15.027 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T12:48:15.069 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T12:48:15.163 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T12:48:15.194 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T12:48:15.234 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T12:48:15.259 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T12:48:15.284 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T12:48:15.358 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T12:48:15.486 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T12:48:15.517 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T12:48:15.545 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T12:48:15.579 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T12:48:15.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T12:48:15.650 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T12:48:15.881 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T12:48:15.915 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T12:48:15.957 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T12:48:16.000 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T12:48:16.033 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T12:48:16.125 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T12:48:16.172 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T12:48:16.211 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T12:48:16.258 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T12:48:16.366 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T12:48:16.420 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T12:48:17.144 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T12:48:17.193 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T12:48:17.226 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T12:48:17.325 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T12:48:17.383 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T12:48:17.463 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T12:48:17.495 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T12:48:17.674 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T12:48:17.738 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T12:48:17.950 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T12:48:18.668 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T12:48:18.791 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T12:48:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2024-04-25T12:48:19.830 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/156 2024-04-25T12:48:20.014 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T12:48:20.079 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/156 2024-04-25T12:48:20.097 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T12:48:20.125 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T12:48:20.133 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/156 2024-04-25T12:48:20.158 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T12:48:20.174 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/156 2024-04-25T12:48:20.199 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/156 2024-04-25T12:48:20.252 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/156 2024-04-25T12:48:20.470 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T12:48:20.513 INFO:teuthology.orchestra.run.smithi157.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T12:48:20.579 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/156 2024-04-25T12:48:20.603 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T12:48:20.634 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T12:48:20.671 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T12:48:20.683 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T12:48:20.805 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T12:48:20.834 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T12:48:20.926 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T12:48:20.956 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T12:48:21.106 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/156 2024-04-25T12:48:21.146 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T12:48:21.152 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/156 2024-04-25T12:48:21.174 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T12:48:21.180 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T12:48:21.262 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T12:48:21.283 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T12:48:21.289 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T12:48:21.307 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T12:48:21.369 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 14/156 2024-04-25T12:48:21.391 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T12:48:21.415 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/156 2024-04-25T12:48:21.605 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T12:48:21.645 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/156 2024-04-25T12:48:21.768 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 17/156 2024-04-25T12:48:21.871 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 18/156 2024-04-25T12:48:21.932 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/156 2024-04-25T12:48:21.969 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/156 2024-04-25T12:48:22.040 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 21/156 2024-04-25T12:48:22.083 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 22/156 2024-04-25T12:48:22.127 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 23/156 2024-04-25T12:48:22.159 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 24/156 2024-04-25T12:48:22.187 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-5.4.4-4.el9.x86_64 25/156 2024-04-25T12:48:22.256 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 26/156 2024-04-25T12:48:22.309 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 27/156 2024-04-25T12:48:22.348 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 28/156 2024-04-25T12:48:22.392 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/156 2024-04-25T12:48:22.468 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/156 2024-04-25T12:48:22.502 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 31/156 2024-04-25T12:48:22.554 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 32/156 2024-04-25T12:48:22.583 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 33/156 2024-04-25T12:48:22.653 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 34/156 2024-04-25T12:48:22.698 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : luarocks-3.9.2-1.el9.noarch 35/156 2024-04-25T12:48:22.773 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 36/156 2024-04-25T12:48:22.915 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 37/156 2024-04-25T12:48:22.976 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 38/156 2024-04-25T12:48:23.501 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 39/156 2024-04-25T12:48:23.588 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 40/156 2024-04-25T12:48:23.616 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T12:48:23.625 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 41/156 2024-04-25T12:48:23.647 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T12:48:23.668 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 42/156 2024-04-25T12:48:23.706 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 43/156 2024-04-25T12:48:23.765 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 44/156 2024-04-25T12:48:23.923 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 45/156 2024-04-25T12:48:23.978 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 46/156 2024-04-25T12:48:24.031 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 47/156 2024-04-25T12:48:24.104 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 48/156 2024-04-25T12:48:24.135 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 49/156 2024-04-25T12:48:24.163 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 50/156 2024-04-25T12:48:24.192 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T12:48:24.210 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 51/156 2024-04-25T12:48:24.234 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T12:48:24.246 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 52/156 2024-04-25T12:48:24.289 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 53/156 2024-04-25T12:48:24.308 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T12:48:24.309 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T12:48:24.309 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T12:48:24.309 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:24.340 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 54/156 2024-04-25T12:48:24.352 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T12:48:24.475 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 55/156 2024-04-25T12:48:24.529 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 56/156 2024-04-25T12:48:24.559 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 57/156 2024-04-25T12:48:24.600 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 58/156 2024-04-25T12:48:24.694 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 59/156 2024-04-25T12:48:24.742 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 60/156 2024-04-25T12:48:24.782 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 61/156 2024-04-25T12:48:24.809 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 62/156 2024-04-25T12:48:24.833 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 63/156 2024-04-25T12:48:24.907 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 64/156 2024-04-25T12:48:25.035 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 65/156 2024-04-25T12:48:25.065 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 66/156 2024-04-25T12:48:25.093 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 67/156 2024-04-25T12:48:25.128 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 68/156 2024-04-25T12:48:25.167 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 69/156 2024-04-25T12:48:25.198 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 70/156 2024-04-25T12:48:25.245 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 71/156 2024-04-25T12:48:25.280 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 72/156 2024-04-25T12:48:25.313 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 73/156 2024-04-25T12:48:25.364 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 74/156 2024-04-25T12:48:25.398 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 75/156 2024-04-25T12:48:25.484 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 76/156 2024-04-25T12:48:25.528 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 77/156 2024-04-25T12:48:25.568 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 78/156 2024-04-25T12:48:25.615 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 79/156 2024-04-25T12:48:25.713 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-packaging-20.9-5.el9.noarch 80/156 2024-04-25T12:48:25.761 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 81/156 2024-04-25T12:48:26.487 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 82/156 2024-04-25T12:48:26.542 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 83/156 2024-04-25T12:48:26.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 84/156 2024-04-25T12:48:26.676 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 85/156 2024-04-25T12:48:26.741 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 86/156 2024-04-25T12:48:26.830 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 87/156 2024-04-25T12:48:26.862 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 88/156 2024-04-25T12:48:27.038 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 89/156 2024-04-25T12:48:27.076 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 90/156 2024-04-25T12:48:27.153 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 91/156 2024-04-25T12:48:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 92/156 2024-04-25T12:48:27.907 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 93/156 2024-04-25T12:48:29.133 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 94/156 2024-04-25T12:48:29.206 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 95/156 2024-04-25T12:48:29.226 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 96/156 2024-04-25T12:48:29.251 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 97/156 2024-04-25T12:48:29.564 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 98/156 2024-04-25T12:48:29.630 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T12:48:29.703 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 99/156 2024-04-25T12:48:29.735 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 100/156 2024-04-25T12:48:29.771 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 101/156 2024-04-25T12:48:30.249 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 102/156 2024-04-25T12:48:30.275 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T12:48:30.346 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 103/156 2024-04-25T12:48:30.369 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 104/156 2024-04-25T12:48:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T12:48:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T12:48:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 105/156 2024-04-25T12:48:33.294 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T12:48:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 106/156 2024-04-25T12:48:33.384 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-25T12:48:33.384 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-25T12:48:33.384 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:33.403 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T12:48:35.817 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /sys 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /proc 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /mnt 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /var/tmp 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /home 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /root 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout:skipping the directory /tmp 2024-04-25T12:48:35.818 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:35.998 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T12:48:36.013 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T12:48:36.013 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:36.013 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T12:48:36.013 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:37.493 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T12:48:37.518 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T12:48:37.519 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:37.519 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T12:48:37.519 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T12:48:37.519 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T12:48:37.519 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:37.743 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T12:48:37.766 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T12:48:37.766 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:37.766 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T12:48:37.766 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T12:48:37.767 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T12:48:37.767 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:38.219 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T12:48:38.242 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T12:48:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T12:48:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T12:48:38.242 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T12:48:38.242 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:38.341 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T12:48:38.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T12:48:38.452 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T12:48:38.646 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T12:48:38.694 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T12:48:38.772 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T12:48:38.861 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T12:48:38.992 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T12:48:39.036 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T12:48:39.068 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T12:48:39.096 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T12:48:39.557 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T12:48:39.586 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T12:48:39.618 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T12:48:39.680 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T12:48:39.718 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T12:48:40.749 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T12:48:40.786 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T12:48:41.750 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T12:48:41.778 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T12:48:41.880 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T12:48:42.051 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T12:48:42.080 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T12:48:42.103 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T12:48:42.103 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:42.103 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T12:48:42.103 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T12:48:42.103 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T12:48:42.103 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:42.147 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T12:48:42.158 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T12:48:42.257 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T12:48:42.313 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T12:48:43.246 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T12:48:43.275 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T12:48:43.298 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T12:48:43.298 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:43.298 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T12:48:43.298 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:48:43.298 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:48:43.298 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:43.343 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T12:48:43.365 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T12:48:43.365 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:43.365 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T12:48:43.365 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:43.410 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T12:48:43.432 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T12:48:43.432 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:43.432 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T12:48:43.432 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:48:43.432 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:48:43.432 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:43.735 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T12:48:43.758 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T12:48:43.758 INFO:teuthology.orchestra.run.smithi157.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:43.758 INFO:teuthology.orchestra.run.smithi157.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T12:48:43.759 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T12:48:43.759 INFO:teuthology.orchestra.run.smithi157.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T12:48:43.759 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 107/156 2024-04-25T12:48:45.034 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2024-04-25T12:48:45.034 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2024-04-25T12:48:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2024-04-25T12:48:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2024-04-25T12:48:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2024-04-25T12:48:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2024-04-25T12:48:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2024-04-25T12:48:45.036 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:45.226 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T12:48:45.242 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 108/156 2024-04-25T12:48:45.242 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:45.242 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-25T12:48:45.242 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:46.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T12:48:46.730 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 109/156 2024-04-25T12:48:46.730 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:46.730 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-25T12:48:46.730 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T12:48:46.730 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-25T12:48:46.730 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:46.955 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T12:48:46.977 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 110/156 2024-04-25T12:48:46.978 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:46.978 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-25T12:48:46.978 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T12:48:46.978 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-25T12:48:46.978 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:47.423 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T12:48:47.444 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 111/156 2024-04-25T12:48:47.445 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:47.445 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-25T12:48:47.445 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T12:48:47.445 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-25T12:48:47.445 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:47.546 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 112/156 2024-04-25T12:48:47.601 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 113/156 2024-04-25T12:48:47.656 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 114/156 2024-04-25T12:48:47.843 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 115/156 2024-04-25T12:48:47.890 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 116/156 2024-04-25T12:48:47.960 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 117/156 2024-04-25T12:48:48.048 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T12:48:48.187 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T12:48:48.224 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 120/156 2024-04-25T12:48:48.255 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 121/156 2024-04-25T12:48:48.283 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 122/156 2024-04-25T12:48:48.381 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T12:48:48.421 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T12:48:48.463 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T12:48:48.495 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T12:48:48.522 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T12:48:48.706 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T12:48:48.744 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T12:48:48.751 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T12:48:48.774 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 123/156 2024-04-25T12:48:48.781 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T12:48:48.806 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 124/156 2024-04-25T12:48:48.868 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 125/156 2024-04-25T12:48:48.905 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T12:48:49.363 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T12:48:49.397 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T12:48:49.415 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T12:48:49.949 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 126/156 2024-04-25T12:48:49.982 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T12:48:50.249 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T12:48:50.367 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T12:48:50.408 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T12:48:50.490 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T12:48:50.547 INFO:teuthology.orchestra.run.smithi157.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T12:48:50.547 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T12:48:50.630 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T12:48:50.655 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T12:48:50.655 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T12:48:50.739 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T12:48:50.804 INFO:teuthology.orchestra.run.smithi157.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T12:48:50.951 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 127/156 2024-04-25T12:48:50.983 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T12:48:51.084 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 128/156 2024-04-25T12:48:51.247 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 129/156 2024-04-25T12:48:51.277 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T12:48:51.299 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 130/156 2024-04-25T12:48:51.300 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:51.300 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-25T12:48:51.300 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T12:48:51.300 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-25T12:48:51.300 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:51.344 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T12:48:51.355 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 131/156 2024-04-25T12:48:51.455 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 132/156 2024-04-25T12:48:51.509 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 133/156 2024-04-25T12:48:52.435 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 134/156 2024-04-25T12:48:52.464 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T12:48:52.485 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 135/156 2024-04-25T12:48:52.485 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:52.485 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-25T12:48:52.486 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:48:52.486 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-25T12:48:52.486 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:52.539 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T12:48:52.561 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 136/156 2024-04-25T12:48:52.561 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:52.561 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-25T12:48:52.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:52.606 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T12:48:52.629 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 137/156 2024-04-25T12:48:52.629 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:52.629 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-25T12:48:52.629 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:48:52.629 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-25T12:48:52.629 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:52.932 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T12:48:52.954 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 138/156 2024-04-25T12:48:52.954 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-25T12:48:52.954 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-25T12:48:52.955 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T12:48:52.955 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-25T12:48:52.955 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T12:48:56.868 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T12:48:56.869 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T12:48:56.870 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T12:48:56.871 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T12:48:56.872 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T12:48:56.873 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T12:48:56.874 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T12:48:56.875 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T12:48:56.876 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T12:48:56.877 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T12:48:56.878 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T12:48:56.879 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T12:48:57.544 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 139/156 2024-04-25T12:48:57.585 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 140/156 2024-04-25T12:48:57.626 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 141/156 2024-04-25T12:48:57.658 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 142/156 2024-04-25T12:48:57.685 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 143/156 2024-04-25T12:48:57.875 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 144/156 2024-04-25T12:48:57.923 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 145/156 2024-04-25T12:48:57.954 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 146/156 2024-04-25T12:48:58.542 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T12:48:58.585 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T12:48:58.604 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 147/156 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout:Upgraded: 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T12:48:58.911 INFO:teuthology.orchestra.run.smithi157.stdout:Installed: 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.912 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.913 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T12:48:58.914 INFO:teuthology.orchestra.run.smithi157.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.915 INFO:teuthology.orchestra.run.smithi157.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T12:48:58.916 INFO:teuthology.orchestra.run.smithi157.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T12:48:58.917 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T12:48:58.918 INFO:teuthology.orchestra.run.smithi157.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T12:48:58.919 INFO:teuthology.orchestra.run.smithi157.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T12:48:58.920 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T12:48:58.921 INFO:teuthology.orchestra.run.smithi157.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T12:48:58.922 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T12:48:58.923 INFO:teuthology.orchestra.run.smithi157.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T12:48:58.924 INFO:teuthology.orchestra.run.smithi157.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T12:48:58.924 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:48:58.924 INFO:teuthology.orchestra.run.smithi157.stdout:Complete! 2024-04-25T12:48:59.275 DEBUG:teuthology.parallel:result is None 2024-04-25T12:48:59.430 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 148/156 2024-04-25T12:48:59.524 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 149/156 2024-04-25T12:48:59.564 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 150/156 2024-04-25T12:48:59.646 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 151/156 2024-04-25T12:48:59.678 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 152/156 2024-04-25T12:48:59.678 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T12:48:59.762 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/156 2024-04-25T12:48:59.795 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T12:48:59.795 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T12:48:59.889 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 155/156 2024-04-25T12:48:59.960 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T12:49:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T12:49:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 1/156 2024-04-25T12:49:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2/156 2024-04-25T12:49:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 3/156 2024-04-25T12:49:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 4/156 2024-04-25T12:49:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3156.gd69f1 5/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 6/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 7/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 8/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 9/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 10/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 11/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 12/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 13/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 14/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_ 15/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 16/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 17/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_6 18/156 2024-04-25T12:49:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86 19/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 20/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el 21/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7. 22/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_6 23/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 24/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 25/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 26/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 27/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 28/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 29/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8. 30/156 2024-04-25T12:49:05.957 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noa 31/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.n 32/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69 33/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el 34/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 35/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.e 36/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 37/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 38/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 39/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/156 2024-04-25T12:49:05.970 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/156 2024-04-25T12:49:05.971 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/156 2024-04-25T12:49:05.972 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/156 2024-04-25T12:49:05.973 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/156 2024-04-25T12:49:05.974 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 108/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 109/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/156 2024-04-25T12:49:05.975 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 113/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/156 2024-04-25T12:49:05.976 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/156 2024-04-25T12:49:05.977 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 149/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 151/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 153/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 154/156 2024-04-25T12:49:05.978 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 155/156 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 156/156 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-04-25T12:49:07.993 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.994 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.995 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:19.0.0-3156.gd69f13d8.el7.noarch 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-25T12:49:07.996 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-25T12:49:07.997 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: lua-5.4.4-4.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.14-1.el9.x86_64 2024-04-25T12:49:07.998 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-25T12:49:07.999 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-25T12:49:08.000 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-25T12:49:08.001 INFO:teuthology.orchestra.run.smithi132.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:08.002 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-25T12:49:08.003 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:19.0.0-3156.gd69f13d8.el7.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-25T12:49:08.004 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-25T12:49:08.005 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-04-25T12:49:08.005 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:08.005 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2024-04-25T12:49:08.396 DEBUG:teuthology.parallel:result is None 2024-04-25T12:49:08.397 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:49:08.559 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T12:49:08.580 INFO:teuthology.orchestra.run.smithi132.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T12:49:08.581 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T12:49:08.581 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T12:49:08.583 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-25T12:49:08.724 DEBUG:teuthology.orchestra.run.smithi157:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T12:49:08.750 INFO:teuthology.orchestra.run.smithi157.stdout:19.0.0-3156.gd69f13d8.el7 2024-04-25T12:49:08.750 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156.gd69f13d8.el7 2024-04-25T12:49:08.750 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156.gd69f13d8 is installed. 2024-04-25T12:49:08.752 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T12:49:08.752 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:08.752 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T12:49:08.778 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:08.778 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T12:49:08.820 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T12:49:08.820 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:08.820 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T12:49:08.844 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T12:49:08.907 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:08.907 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T12:49:08.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T12:49:08.999 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T12:49:08.999 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:08.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T12:49:09.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T12:49:09.087 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:09.087 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T12:49:09.112 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T12:49:09.177 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T12:49:09.178 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:09.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T12:49:09.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T12:49:09.265 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:09.265 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T12:49:09.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T12:49:09.354 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T12:49:09.444 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T12:49:09.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2024-04-25T12:49:09.447 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 777 /var/log/ceph 2024-04-25T12:49:09.470 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T12:49:09.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T12:49:09.510 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T12:49:09.534 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T12:49:09.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T12:49:09.574 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T12:49:09.605 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-25T12:49:09.605 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-25T12:49:09.605 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-25T12:49:09.605 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:09.605 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T12:49:09.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T12:49:09.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T12:49:09.804 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:09.804 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-25T12:49:09.819 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-25T12:49:09.928 DEBUG:teuthology.orchestra.run.smithi157:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-25T12:49:09.972 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T12:49:09.972 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T12:49:09.972 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}}', 'email': None, 'first_in_suite': False, 'job_id': '7673448', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '4d7908725372ec8e17504b848bfa122dd1d43386'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 4060, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '4d7908725372ec8e17504b848bfa122dd1d43386', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuNkucXJ59SCCtKF9QP3S/igSOJVVar6YZHqvGRg/PZNNcojFxZfKZIT+B6eAt7JKG80Vn1P2cImAhhzrdwapE=', 'smithi157.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIN6oMNfw4CzQMukc5lb6k7IFKiz9TxPa2AnDYcuE1VjUzAcxklYW5IFuOjAwz6YhvLzaraq0FcFETCAUZwezo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'kclient': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_12:17:05', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T12:49:09.973 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T12:49:09.975 DEBUG:teuthology.orchestra.run.smithi157:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T12:49:10.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T12:49:10.030 DEBUG:teuthology.orchestra.run.smithi157:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T12:49:10.085 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:10.085 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T12:49:10.106 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T12:49:10.106 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2024-04-25T12:49:10.160 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T12:49:10.160 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:10.160 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-04-25T12:49:10.160 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:10.160 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:10.161 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 12:49:00.322974511 +0000 2024-04-25T12:49:10.161 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 12:46:40.776458212 +0000 2024-04-25T12:49:10.161 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 12:46:40.776458212 +0000 2024-04-25T12:49:10.161 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 12:46:40.776458212 +0000 2024-04-25T12:49:10.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T12:49:10.221 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T12:49:10.222 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T12:49:10.222 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000181861 s, 2.8 MB/s 2024-04-25T12:49:10.223 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T12:49:10.279 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 12:49:00.322974511 +0000 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 12:46:41.119449154 +0000 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 12:46:41.119449154 +0000 2024-04-25T12:49:10.335 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 12:46:41.119449154 +0000 2024-04-25T12:49:10.336 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T12:49:10.397 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T12:49:10.397 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T12:49:10.397 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000179245 s, 2.9 MB/s 2024-04-25T12:49:10.399 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T12:49:10.454 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2024-04-25T12:49:10.510 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T12:49:10.510 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:10.511 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-04-25T12:49:10.511 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:10.511 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:10.511 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 12:49:00.323974485 +0000 2024-04-25T12:49:10.511 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 12:46:41.448440465 +0000 2024-04-25T12:49:10.511 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 12:46:41.448440465 +0000 2024-04-25T12:49:10.512 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 12:46:41.448440465 +0000 2024-04-25T12:49:10.512 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T12:49:10.573 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T12:49:10.574 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T12:49:10.574 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000199935 s, 2.6 MB/s 2024-04-25T12:49:10.575 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T12:49:10.630 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2024-04-25T12:49:10.686 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T12:49:10.686 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:10.686 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-04-25T12:49:10.686 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:10.686 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:10.687 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2024-04-25 12:49:00.323974485 +0000 2024-04-25T12:49:10.687 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2024-04-25 12:46:41.806431010 +0000 2024-04-25T12:49:10.687 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2024-04-25 12:46:41.806431010 +0000 2024-04-25T12:49:10.687 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2024-04-25 12:46:41.806431010 +0000 2024-04-25T12:49:10.687 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T12:49:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2024-04-25T12:49:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2024-04-25T12:49:10.748 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000172319 s, 3.0 MB/s 2024-04-25T12:49:10.749 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T12:49:10.804 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:10.804 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:10.804 DEBUG:teuthology.orchestra.run.smithi157:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T12:49:10.822 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T12:49:10.822 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_1 2024-04-25T12:49:10.878 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T12:49:10.878 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:10.878 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-04-25T12:49:10.879 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:10.879 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:10.879 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-25 12:48:51.165120292 +0000 2024-04-25T12:49:10.879 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-25 12:47:08.032200234 +0000 2024-04-25T12:49:10.879 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-25 12:47:08.032200234 +0000 2024-04-25T12:49:10.879 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-25 12:47:08.032200234 +0000 2024-04-25T12:49:10.879 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T12:49:10.942 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-25T12:49:10.942 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-25T12:49:10.943 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000108561 s, 4.7 MB/s 2024-04-25T12:49:10.944 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T12:49:11.000 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_2 2024-04-25T12:49:11.056 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T12:49:11.056 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:11.056 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-04-25T12:49:11.056 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:11.056 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:11.057 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-25 12:48:51.165120292 +0000 2024-04-25T12:49:11.057 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-25 12:47:08.351194206 +0000 2024-04-25T12:49:11.057 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-25 12:47:08.351194206 +0000 2024-04-25T12:49:11.057 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-25 12:47:08.351194206 +0000 2024-04-25T12:49:11.057 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T12:49:11.118 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-25T12:49:11.118 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-25T12:49:11.118 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000120815 s, 4.2 MB/s 2024-04-25T12:49:11.119 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T12:49:11.176 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_3 2024-04-25T12:49:11.230 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-25 12:48:51.166120274 +0000 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-25 12:47:08.683187934 +0000 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-25 12:47:08.683187934 +0000 2024-04-25T12:49:11.231 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-25 12:47:08.683187934 +0000 2024-04-25T12:49:11.231 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T12:49:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-25T12:49:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-25T12:49:11.293 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 7.8683e-05 s, 6.5 MB/s 2024-04-25T12:49:11.294 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T12:49:11.349 DEBUG:teuthology.orchestra.run.smithi157:> stat /dev/vg_nvme/lv_4 2024-04-25T12:49:11.404 INFO:teuthology.orchestra.run.smithi157.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout:Device: 5h/5d Inode: 720 Links: 1 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout:Access: 2024-04-25 12:48:51.166120274 +0000 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout:Modify: 2024-04-25 12:47:08.989182152 +0000 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout:Change: 2024-04-25 12:47:08.989182152 +0000 2024-04-25T12:49:11.405 INFO:teuthology.orchestra.run.smithi157.stdout: Birth: 2024-04-25 12:47:08.989182152 +0000 2024-04-25T12:49:11.405 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T12:49:11.466 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records in 2024-04-25T12:49:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:1+0 records out 2024-04-25T12:49:11.467 INFO:teuthology.orchestra.run.smithi157.stderr:512 bytes copied, 0.000101362 s, 5.1 MB/s 2024-04-25T12:49:11.468 DEBUG:teuthology.orchestra.run.smithi157:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T12:49:11.523 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:11.523 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T12:49:11.523 INFO:tasks.ceph:Generating config... 2024-04-25T12:49:11.525 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T12:49:11.525 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-25T12:49:11.525 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T12:49:11.525 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T12:49:11.525 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T12:49:11.525 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T12:49:11.525 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-04-25T12:49:11.525 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T12:49:11.525 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T12:49:11.525 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-25T12:49:11.526 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T12:49:11.527 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T12:49:11.528 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T12:49:11.528 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T12:49:11.528 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T12:49:11.528 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T12:49:11.528 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T12:49:11.528 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T12:49:11.529 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T12:49:11.529 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T12:49:11.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T12:49:11.579 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T12:49:11.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T12:49:11.620 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:49:11.684 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132'), ('mon.b', '172.21.15.157'), ('mon.c', '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]')] 2024-04-25T12:49:11.685 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T12:49:11.686 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:11.686 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T12:49:11.741 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --add b 172.21.15.157 --addv c '[v2:172.21.15.157:3301,v1:172.21.15.157:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid 5bda364d-1418-47e5-9931-4f49e5bffd9b 2024-04-25T12:49:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = quincy 2024-04-25T12:49:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2024-04-25T12:49:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:fsid 5bda364d-1418-47e5-9931-4f49e5bffd9b 2024-04-25T12:49:11.826 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2024-04-25T12:49:11.829020+0000 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:created 2024-04-25T12:49:11.829020+0000 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 17 (quincy) 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:1: [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] mon.b 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:2: [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] mon.c 2024-04-25T12:49:11.827 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T12:49:11.828 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T12:49:11.843 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 5bda364d-1418-47e5-9931-4f49e5bffd9b... 2024-04-25T12:49:11.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T12:49:11.885 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T12:49:11.923 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.924 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2024-04-25T12:49:11.925 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2024-04-25T12:49:11.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.132,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = 5bda364d-1418-47e5-9931-4f49e5bffd9b 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2024-04-25T12:49:11.927 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug trim objects = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.928 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: mon client directed command retry = 5 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2024-04-25T12:49:11.929 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay max = 1 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay probability = 0.005 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay type = client mds 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject socket failures = 2500 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: osd blocked scrub grace period = 3600 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: osd max markdown count = 1000 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-25T12:49:11.930 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2024-04-25T12:49:11.931 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2024-04-25T12:49:11.932 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: mon down mkfs grace = 300 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T12:49:11.933 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout: client_shutdown_timeout = 120 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.e] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-04-25T12:49:11.934 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.f] 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal fragment size max = 10000 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal merge size = 5 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal split bits = 3 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal split size = 100 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds oft prefetch dirfrags = True 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2024-04-25T12:49:11.935 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: mds_dir_prefetch = True 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: mon client directed command retry = 5 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay max = 1 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay probability = 0.005 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject delay type = client mds osd 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: ms inject socket failures = 2500 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2024-04-25T12:49:11.936 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout:[global] 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: chdir = "" 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: auth supported = cephx 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: filestore xattr use omap = true 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.938 INFO:teuthology.orchestra.run.smithi157.stdout: mon clock drift allowed = 1.000 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: osd crush chooseleaf type = 0 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: auth debug = true 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on old message = true 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on bug = true 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: mon pg warn max object skew = 0 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T12:49:11.939 INFO:teuthology.orchestra.run.smithi157.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default size = 2 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow primary affinity = true 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd allow pg remap = true 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on legacy crush tunables = false 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on crush straw calc version zero = false 2024-04-25T12:49:11.940 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on no sortbitwise = false 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on osd down out interval zero = false 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon warn on too few osds = false 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon_allow_pool_size_one = true 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: osd default data pool replay window = 5 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon allow pool delete = true 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.941 INFO:teuthology.orchestra.run.smithi157.stdout: mon cluster log file level = debug 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: debug asserts on shutdown = true 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: mon health detail to clog = false 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: mon host = "172.21.15.132,172.21.15.157,[v2:172.21.15.157:3301,v1:172.21.15.157:6790]" 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: ms die on skipped message = False 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: fsid = 5bda364d-1418-47e5-9931-4f49e5bffd9b 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout:[osd] 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: osd journal size = 100 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub load threshold = 5.0 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: osd scrub max interval = 600 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: osd mclock profile = high_recovery_ops 2024-04-25T12:49:11.942 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd recover clone overlap = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd recovery max chunk = 1048576 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug shutdown = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug op order = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug verify stray on activate = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug trim objects = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd open classes on start = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug pg log writeout = true 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd deep scrub update digest min age = 30 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.943 INFO:teuthology.orchestra.run.smithi157.stdout: osd map max advance = 10 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: journal zero on create = true 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: filestore ondisk finisher threads = 3 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: filestore apply finisher threads = 3 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: bdev debug aio = true 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: osd debug misdirected ops = true 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore block size = 96636764160 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: bluestore fsck on mount = True 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluefs = 20 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: debug bluestore = 20 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: debug osd = 20 2024-04-25T12:49:11.944 INFO:teuthology.orchestra.run.smithi157.stdout: debug rocksdb = 10 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd full ratio = 0.9 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd nearfull ratio = 0.8 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay max = 1 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay probability = 0.005 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay type = client mds 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 2500 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: osd blocked scrub grace period = 3600 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: osd failsafe full ratio = 0.95 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: osd max markdown count = 1000 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: osd objectstore = bluestore 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.945 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr] 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug mgr = 20 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: mgr/telemetry/nag = false 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout:[mon] 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug mon = 20 2024-04-25T12:49:11.946 INFO:teuthology.orchestra.run.smithi157.stdout: debug paxos = 20 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: debug auth = 20 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon data avail warn = 5 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon mgr mkfs grace = 240 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min pgs per osd = 4 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd reporter subtree level = osd 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon osd prime pg temp = true 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon reweight min bytes per osd = 10 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.947 INFO:teuthology.orchestra.run.smithi157.stdout: # 1m isn't quite enough 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: mon_down_mkfs_grace = 2m 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: mon_warn_on_filestore_osds = false 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: mon down mkfs grace = 300 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: mon op complaint time = 120 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout:[client] 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: rgw cache enabled = true 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable ops log = true 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: rgw enable usage log = true 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: client mount timeout = 600 2024-04-25T12:49:11.948 INFO:teuthology.orchestra.run.smithi157.stdout: client_shutdown_timeout = 120 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: debug client = 20 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.a] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.b] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mon.c] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.e] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.f] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout:[mds] 2024-04-25T12:49:11.949 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds = 20 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: debug mds balancer = 20 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: debug ms = 1 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal fragment size max = 10000 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal merge size = 5 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal split bits = 3 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds bal split size = 100 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug frag = True 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds debug scatterstat = True 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds oft prefetch dirfrags = True 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds op complaint time = 180 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds verify scatter = True 2024-04-25T12:49:11.950 INFO:teuthology.orchestra.run.smithi157.stdout: mds_dir_prefetch = True 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: mds_sleep_rank_change = 5000000.0 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: mon client directed command retry = 5 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay max = 1 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay probability = 0.005 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject delay type = client mds osd 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: ms inject socket failures = 2500 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: osd op complaint time = 180 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: rados mon op timeout = 900 2024-04-25T12:49:11.951 INFO:teuthology.orchestra.run.smithi157.stdout: rados osd op timeout = 900 2024-04-25T12:49:11.951 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T12:49:11.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T12:49:12.031 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T12:49:12.031 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:12.031 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T12:49:12.045 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:12.046 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T12:49:12.100 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:49:12.100 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:12.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T12:49:12.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:49:12.183 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:12.183 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:12.237 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:49:12.238 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:12.238 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T12:49:12.238 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T12:49:12.271 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:12.272 DEBUG:teuthology.orchestra.run.smithi157:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:12.327 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T12:49:12.327 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T12:49:12.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T12:49:12.375 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T12:49:12.378 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T12:49:12.439 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T12:49:12.442 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T12:49:12.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T12:49:12.490 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T12:49:12.493 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T12:49:12.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T12:49:12.604 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T12:49:12.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T12:49:12.630 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T12:49:12.718 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-25T12:49:12.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-25T12:49:12.744 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T12:49:12.792 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T12:49:12.795 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T12:49:12.819 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T12:49:12.907 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-25T12:49:12.910 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-25T12:49:12.933 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T12:49:13.021 INFO:teuthology.orchestra.run.smithi157.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-25T12:49:13.024 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-25T12:49:13.047 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T12:49:13.047 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T12:49:13.087 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T12:49:13.099 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T12:49:13.099 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi157.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-25T12:49:13.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T12:49:13.162 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:13.162 INFO:tasks.ceph:role: osd.0 2024-04-25T12:49:13.163 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:49:13.163 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T12:49:13.233 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:13.233 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:13.234 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:13.762 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T12:49:13.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T12:49:13.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T12:49:13.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T12:49:13.925 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T12:49:13.989 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:13.989 INFO:tasks.ceph:role: osd.1 2024-04-25T12:49:13.989 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:49:13.990 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T12:49:14.060 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:14.061 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T12:49:14.515 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T12:49:14.515 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T12:49:14.601 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T12:49:14.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T12:49:14.732 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:14.732 INFO:tasks.ceph:role: osd.2 2024-04-25T12:49:14.732 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:49:14.732 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T12:49:14.802 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:14.803 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:15.301 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T12:49:15.303 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T12:49:15.303 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T12:49:15.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T12:49:15.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T12:49:15.544 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:15.544 INFO:tasks.ceph:role: osd.3 2024-04-25T12:49:15.544 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:49:15.544 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:15.616 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:15.617 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:15.617 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:16.138 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2024-04-25T12:49:16.139 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2024-04-25T12:49:16.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T12:49:16.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T12:49:16.288 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:16.386+0000 7f841e812640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T12:49:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:16.386+0000 7f841e812640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T12:49:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:16.386+0000 7f841e812640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:49:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:16.386+0000 7f841e812640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:49:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:16.386+0000 7f841e812640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T12:49:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:16.386+0000 7f841e812640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T12:49:19.242 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T12:49:19.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:19.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:19.360+0000 7f9a0f753640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T12:49:19.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:19.361+0000 7f9a0f753640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T12:49:19.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:19.361+0000 7f9a0f753640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:49:19.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:19.361+0000 7f9a0f753640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:49:19.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:19.361+0000 7f9a0f753640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T12:49:19.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:19.362+0000 7f9a0f753640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T12:49:22.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T12:49:22.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:22.336+0000 7faad5d2c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T12:49:22.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:22.336+0000 7faad5d2c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T12:49:22.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:22.336+0000 7faad5d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:49:22.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:22.336+0000 7faad5d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:49:22.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:22.336+0000 7faad5d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T12:49:22.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:22.336+0000 7faad5d2c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T12:49:25.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T12:49:25.213 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:25.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:25.304+0000 7ffa22e14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T12:49:25.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:25.304+0000 7ffa22e14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T12:49:25.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:25.304+0000 7ffa22e14640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:49:25.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:25.304+0000 7ffa22e14640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:49:25.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:25.304+0000 7ffa22e14640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T12:49:25.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:25.305+0000 7ffa22e14640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T12:49:28.171 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T12:49:28.199 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T12:49:28.229 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:28.229 INFO:tasks.ceph:role: osd.4 2024-04-25T12:49:28.229 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:49:28.229 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T12:49:28.295 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:28.296 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:28.328 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-25T12:49:28.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-25T12:49:28.330 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-25T12:49:28.399 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T12:49:28.467 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T12:49:28.531 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:28.532 INFO:tasks.ceph:role: osd.5 2024-04-25T12:49:28.532 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:49:28.532 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T12:49:28.595 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:28.596 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:28.627 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-25T12:49:28.629 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-25T12:49:28.629 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-25T12:49:28.696 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T12:49:28.765 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-25T12:49:28.829 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:28.829 INFO:tasks.ceph:role: osd.6 2024-04-25T12:49:28.829 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:49:28.829 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T12:49:28.891 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:28.891 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:28.892 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:28.923 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-25T12:49:28.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-25T12:49:28.925 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-25T12:49:28.992 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-25T12:49:29.059 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-25T12:49:29.123 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-25T12:49:29.124 INFO:tasks.ceph:role: osd.7 2024-04-25T12:49:29.124 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:49:29.124 DEBUG:teuthology.orchestra.run.smithi157:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: = sunit=0 swidth=0 blks 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T12:49:29.187 INFO:teuthology.orchestra.run.smithi157.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T12:49:29.219 INFO:teuthology.orchestra.run.smithi157.stdout:Discarding blocks...Done. 2024-04-25T12:49:29.221 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi157.front.sepia.ceph.com -o noatime 2024-04-25T12:49:29.221 DEBUG:teuthology.orchestra.run.smithi157:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-25T12:49:29.289 DEBUG:teuthology.orchestra.run.smithi157:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-25T12:49:29.356 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:29.450+0000 7fc86782e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T12:49:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:29.451+0000 7fc86782e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T12:49:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:29.451+0000 7fc86782e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:49:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:29.451+0000 7fc86782e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:49:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:29.451+0000 7fc86782e640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T12:49:29.449 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:29.451+0000 7fc86782e640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T12:49:32.294 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T12:49:32.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:32.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:32.412+0000 7ff3daf50640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T12:49:32.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:32.413+0000 7ff3daf50640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T12:49:32.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:32.413+0000 7ff3daf50640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:49:32.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:32.413+0000 7ff3daf50640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:49:32.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:32.413+0000 7ff3daf50640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T12:49:32.411 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:32.413+0000 7ff3daf50640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T12:49:35.257 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T12:49:35.285 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:35.374+0000 7f9bf3015640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-25T12:49:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:35.374+0000 7f9bf3015640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-25T12:49:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:35.374+0000 7f9bf3015640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:49:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:35.374+0000 7f9bf3015640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:49:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:35.374+0000 7f9bf3015640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-25T12:49:35.373 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:35.375+0000 7f9bf3015640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-25T12:49:38.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-25T12:49:38.247 DEBUG:teuthology.orchestra.run.smithi157:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:38.336+0000 7f4ac0611640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-25T12:49:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:38.336+0000 7f4ac0611640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-25T12:49:38.335 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:38.336+0000 7f4ac0611640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:49:38.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:38.336+0000 7f4ac0611640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:49:38.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:38.336+0000 7f4ac0611640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-25T12:49:38.336 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:38.337+0000 7f4ac0611640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-25T12:49:39.974 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:49:39.977 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:49:41.182 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-25T12:49:41.210 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T12:49:41.210 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T12:49:41.239 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.239 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T12:49:41.305 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T12:49:41.372 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.373 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-25T12:49:41.438 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T12:49:41.504 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T12:49:41.570 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T12:49:41.634 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:41.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T12:49:41.699 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:41.700 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T12:49:41.728 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:41.728 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T12:49:41.795 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:41.795 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-25T12:49:41.862 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:41.862 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-25T12:49:41.928 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:41.929 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T12:49:41.995 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:41.995 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T12:49:42.061 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:42.061 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-25T12:49:42.127 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:42.127 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-25T12:49:42.192 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:42.192 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T12:49:42.210 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T12:49:42.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T12:49:42.254 DEBUG:teuthology.orchestra.run.smithi157:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpmsPOPFhAAg8G9MdX743dVi8y7yPoaVg== 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpm98poHRAAmanLRCDs/EPjNqyMilCTUg== 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpm4/MrJBAA23aUm9hZM8o3oarp4VhcbA== 2024-04-25T12:49:42.277 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.e] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpmWvcEKxAAYmSplesIkvOdvZ1XZ8p15w== 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBMUSpmgycQFxAAYTp/qnrQR/mvUEzlxznnkw== 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBPUSpmoVORFRAApwcC7XehVrYG75z7xY5rpA== 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBSUSpmg4EWFBAAyyJ1+n8I42JduLB91S/bLg== 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBVUSpmvNEuEhAAEEaWtq+9n2APJKftuscFGA== 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpmDZxbGhAA7rRQ7tFgM/JdrRVDTSLfHA== 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2024-04-25T12:49:42.278 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpm1xlvLxAAHHesTWtBB9kAOJ//CpNUMg== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBIUSpmSJ5GNhAADk0Zta7YKIMr3x0QKZZQoQ== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.f] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBJUSpmhYd4ARAAS+HiyxgfT1Yek/64f3yiMw== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBZUSpmVM7uGhAAl9a7mHJfqU6zKRTnfVly4g== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBcUSpmTOSrGBAAY3RU02Wcp366TI01V408Pg== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBfUSpmJN9lFhAAHY36QlsOwLIrrjJY7FW/xQ== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBiUSpmQbAgFBAAj4LVIYuh9ZPDvabUtbVDOQ== 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2024-04-25T12:49:42.279 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQBJUSpmvy1iBRAAuTyhTPPeNND7Gtcx7SXoNQ== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.y] 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpmsPOPFhAAg8G9MdX743dVi8y7yPoaVg== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.a] 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpm98poHRAAmanLRCDs/EPjNqyMilCTUg== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.c] 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpm4/MrJBAA23aUm9hZM8o3oarp4VhcbA== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.e] 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpmWvcEKxAAYmSplesIkvOdvZ1XZ8p15w== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.0] 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBMUSpmgycQFxAAYTp/qnrQR/mvUEzlxznnkw== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.1] 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBPUSpmoVORFRAApwcC7XehVrYG75z7xY5rpA== 2024-04-25T12:49:42.281 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.2] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBSUSpmg4EWFBAAyyJ1+n8I42JduLB91S/bLg== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.3] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBVUSpmvNEuEhAAEEaWtq+9n2APJKftuscFGA== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[mgr.x] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpmDZxbGhAA7rRQ7tFgM/JdrRVDTSLfHA== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.b] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpm1xlvLxAAHHesTWtBB9kAOJ//CpNUMg== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.d] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBIUSpmSJ5GNhAADk0Zta7YKIMr3x0QKZZQoQ== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[mds.f] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJUSpmhYd4ARAAS+HiyxgfT1Yek/64f3yiMw== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.4] 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBZUSpmVM7uGhAAl9a7mHJfqU6zKRTnfVly4g== 2024-04-25T12:49:42.282 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.5] 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBcUSpmTOSrGBAAY3RU02Wcp366TI01V408Pg== 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.6] 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBfUSpmJN9lFhAAHY36QlsOwLIrrjJY7FW/xQ== 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout:[osd.7] 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBiUSpmQbAgFBAAj4LVIYuh9ZPDvabUtbVDOQ== 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout:[client.0] 2024-04-25T12:49:42.283 INFO:teuthology.orchestra.run.smithi157.stdout: key = AQBJUSpmvy1iBRAAuTyhTPPeNND7Gtcx7SXoNQ== 2024-04-25T12:49:42.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:49:42.323 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:49:42.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.377 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.433 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.489 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.543 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.594 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.643 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.646 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.697 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:49:42.748 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T12:49:42.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.800 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.854 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.909 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T12:49:42.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:42.963 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.013 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.015 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.067 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.118 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T12:49:43.166 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T12:49:43.169 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T12:49:43.222 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T12:49:43.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T12:49:43.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:49:43.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T12:49:43.361 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T12:49:43.384 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:49:43.479 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T12:49:43.502 DEBUG:teuthology.orchestra.run.smithi157:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T12:49:43.566 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T12:49:43.661 DEBUG:teuthology.orchestra.run.smithi157:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T12:49:43.684 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:43.687 DEBUG:teuthology.orchestra.run.smithi157:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T12:49:43.738 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T12:49:43.739 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T12:49:43.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T12:49:43.741 INFO:tasks.ceph.mon.a:Started 2024-04-25T12:49:43.742 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T12:49:43.742 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T12:49:43.781 INFO:tasks.ceph.mon.b:Started 2024-04-25T12:49:43.782 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T12:49:43.782 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T12:49:43.784 INFO:tasks.ceph.mon.c:Started 2024-04-25T12:49:43.784 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T12:49:43.785 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T12:49:43.786 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T12:49:43.788 INFO:tasks.ceph.mgr.y:Started 2024-04-25T12:49:43.788 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T12:49:43.788 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T12:49:43.789 INFO:tasks.ceph.mgr.x:Started 2024-04-25T12:49:43.790 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T12:49:43.790 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T12:49:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.891+0000 7f9470210640 1 Processor -- start 2024-04-25T12:49:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.891+0000 7f9470210640 1 -- start start 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f9470210640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f9470210640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f9470210640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94680c5f50 con 0x7f9468155500 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f9470210640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f946815f1f0 con 0x7f94680c61a0 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f9470210640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f94680c5c70 con 0x7f94680cb330 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946e7ad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946dfac640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9468155500 0x7f946815bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60586/0 (socket says 172.21.15.132:60586) 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946e7ad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52356/0 (socket says 172.21.15.132:52356) 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 learned_addr learned my addr 172.21.15.132:0/1281103895 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T12:49:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.892+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.893+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.893+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.893+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.893+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.893+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:43.893+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:49:44.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.094+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:49:44.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:44.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:44.495+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T12:49:45.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:45.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:45.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:45.296+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T12:49:46.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 msgr2=0x7f94680cc540 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:49:46.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.157:3300/0 conn(0x7f94680cb330 0x7f94680cc540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 -- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 msgr2=0x7f94680c6630 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 --2- 172.21.15.132:0/1281103895 >> v2:172.21.15.132:3300/0 conn(0x7f94680c61a0 0x7f94680c6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 -- 172.21.15.132:0/1281103895 >> v1:172.21.15.132:6789/0 conn(0x7f9468155500 legacy=0x7f946815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 -- 172.21.15.132:0/1281103895 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f946815e8c0 con 0x7f944c006150 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.892+0000 7f945f7fe640 1 -- 172.21.15.132:0/1281103895 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f946815f1f0 con 0x7f944c003670 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.893+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.893+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.893+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.893+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:46.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:46.893+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T12:49:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.094+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.094+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:49:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.094+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.094+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:47.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.094+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T12:49:47.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.495+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:47.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.495+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:49:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.495+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.495+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:47.495+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T12:49:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:48.296+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:48.297+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T12:49:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:48.297+0000 7f946dfac640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T12:49:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:48.297+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:49:48.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:48.297+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T12:49:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.053+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254143325 0 0) 0x7f946815e8c0 con 0x7f944c006150 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.053+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9454003520 con 0x7f944c006150 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1622658958 0 0) 0x7f9454003520 con 0x7f944c006150 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f944c005ac0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f944c005ac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f944c00af70 con 0x7f944c006150 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f946400d580 con 0x7f944c006150 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 >> v1:172.21.15.157:6789/0 conn(0x7f944c006150 legacy=0x7f944c008610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946e7ad640 1 -- 172.21.15.132:0/1281103895 reap_dead start 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f94540039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454003fc0 0x7f9454004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9454004d40 0x7f94540051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f946815f1f0 con 0x7f9454003fc0 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f945400bca0 con 0x7f9454004d40 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f945400bea0 con 0x7f944c003670 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454003fc0 0x7f9454004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946dfac640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f94540039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946e7ad640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9454004d40 0x7f94540051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 msgr2=0x7f94540039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f94540039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9454004d40 msgr2=0x7f94540051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9454004d40 0x7f94540051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.054+0000 7f946d7ab640 1 -- 172.21.15.132:0/1281103895 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9454003520 con 0x7f9454003fc0 2024-04-25T12:49:49.055 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.056+0000 7f946d7ab640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454003fc0 0x7f9454004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94640134f0 tx=0x7f9454005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bf68666fc0a4f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.056+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9464039070 con 0x7f9454003fc0 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.056+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9464034410 con 0x7f9454003fc0 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.056+0000 7f946cfaa640 1 -- 172.21.15.132:0/1281103895 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f946400de30 con 0x7f9454003fc0 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 -- 172.21.15.132:0/1281103895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454003fc0 msgr2=0x7f9454004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454003fc0 0x7f9454004800 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f94640134f0 tx=0x7f9454005830 comp rx=0 tx=0).stop 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 -- 172.21.15.132:0/1281103895 shutdown_connections 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9454004d40 0x7f94540051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454003fc0 0x7f9454004800 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 --2- 172.21.15.132:0/1281103895 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f944c003670 0x7f94540039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 -- 172.21.15.132:0/1281103895 >> 172.21.15.132:0/1281103895 conn(0x7f9468067c60 msgr2=0x7f9468072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:49.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.057+0000 7f9470210640 1 -- 172.21.15.132:0/1281103895 shutdown_connections 2024-04-25T12:49:49.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.058+0000 7f9470210640 1 -- 172.21.15.132:0/1281103895 wait complete. 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.059+0000 7f9470210640 1 Processor -- start 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.059+0000 7f9470210640 1 -- start start 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f9470210640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 0x7f94681528e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f9470210640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9454003fc0 0x7f94680c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f9470210640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454004d40 0x7f94681f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f9470210640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f94681558e0 con 0x7f9454004d40 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f9470210640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f946815ee80 con 0x7f944c003670 2024-04-25T12:49:49.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f9470210640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f946815f680 con 0x7f9454003fc0 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946e7ad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454004d40 0x7f94681f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 0x7f94681528e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946d7ab640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9454003fc0 0x7f94680c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 0x7f94681528e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:35916/0 (socket says 172.21.15.132:35916) 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 -- 172.21.15.132:0/2271070821 learned_addr learned my addr 172.21.15.132:0/2271070821 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 -- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9454003fc0 msgr2=0x7f94680c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9454003fc0 0x7f94680c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 -- 172.21.15.132:0/2271070821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454004d40 msgr2=0x7f94681f3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454004d40 0x7f94681f3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946dfac640 1 -- 172.21.15.132:0/2271070821 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9468155bc0 con 0x7f944c003670 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.060+0000 7f946d7ab640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9454003fc0 0x7f94680c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f946dfac640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 0x7f94681528e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9458001290 tx=0x7f9458001750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945801c070 con 0x7f944c003670 2024-04-25T12:49:49.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94680c8c50 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9468156140 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9458018710 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458026060 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f945801f070 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.061+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f945802a6e0 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.062+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9468068ce0 con 0x7f944c003670 2024-04-25T12:49:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.065+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9468068ce0 con 0x7f944c003670 2024-04-25T12:49:49.130 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.132+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f94680741e0 con 0x7f944c003670 2024-04-25T12:49:49.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.138+0000 7f945e7fc640 1 -- 172.21.15.132:0/2271070821 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f9458021d10 con 0x7f944c003670 2024-04-25T12:49:49.136 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2024-04-25T12:49:49.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 msgr2=0x7f94681528e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 0x7f94681528e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9458001290 tx=0x7f9458001750 comp rx=0 tx=0).stop 2024-04-25T12:49:49.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 shutdown_connections 2024-04-25T12:49:49.137 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9454004d40 0x7f94681f3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9454003fc0 0x7f94680c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 --2- 172.21.15.132:0/2271070821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f944c003670 0x7f94681528e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 >> 172.21.15.132:0/2271070821 conn(0x7f9468067c60 msgr2=0x7f946815baf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:49.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 shutdown_connections 2024-04-25T12:49:49.138 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:49.139+0000 7f9470210640 1 -- 172.21.15.132:0/2271070821 wait complete. 2024-04-25T12:49:49.149 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T12:49:49.149 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T12:49:49.149 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:49.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T12:49:49.172 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:49.174+0000 7f6c30c12040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T12:49:49.173 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:49.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T12:49:49.236 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:49.236 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T12:49:49.300 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:49:49.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T12:49:49.326 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:49.327+0000 7f6c30c12040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:49:49.349 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:49.349 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T12:49:49.378 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:49.378 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T12:49:49.380 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:49.383+0000 7f6c30c12040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T12:49:49.446 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:49.446 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-25T12:49:49.513 DEBUG:teuthology.orchestra.run.smithi157:> set -ex 2024-04-25T12:49:49.513 DEBUG:teuthology.orchestra.run.smithi157:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-25T12:49:49.578 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 20381eac-0560-48e6-8045-d8dfbb7a5b37 0 2024-04-25T12:49:49.613 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:49.615+0000 7f6c30c12040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T12:49:49.658 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:49.660+0000 7f6c30c12040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T12:49:49.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.720+0000 7f7bf47ad640 1 Processor -- start 2024-04-25T12:49:49.718 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.720+0000 7f7bf47ad640 1 -- start start 2024-04-25T12:49:49.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf47ad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7bec153190 0x7f7bec073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf47ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 0x7f7bec0c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.720 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf47ad640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7bec0c7330 0x7f7bec0c61a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf47ad640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7bec1591b0 con 0x7f7bec153190 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf47ad640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7bec0cc4e0 con 0x7f7bec0c7330 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf47ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7bec159450 con 0x7f7bec0c6f50 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7bec0c7330 0x7f7bec0c61a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf1d48640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 0x7f7bec0c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7bec0c7330 0x7f7bec0c61a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45182/0 (socket says 172.21.15.157:45182) 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf1d48640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 0x7f7bec0c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50494/0 (socket says 172.21.15.157:50494) 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/3220536628 learned_addr learned my addr 172.21.15.157:0/3220536628 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2549640 1 --2- 172.21.15.157:0/3220536628 >> v2:172.21.15.132:3300/0 conn(0x7f7bec153190 0x7f7bec073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 msgr2=0x7f7bec0c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 --2- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 0x7f7bec0c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.721 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/3220536628 >> v2:172.21.15.132:3300/0 conn(0x7f7bec153190 msgr2=0x7f7bec073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 --2- 172.21.15.157:0/3220536628 >> v2:172.21.15.132:3300/0 conn(0x7f7bec153190 0x7f7bec073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/3220536628 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec158ee0 con 0x7f7bec0c7330 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf2549640 1 --2- 172.21.15.157:0/3220536628 >> v2:172.21.15.132:3300/0 conn(0x7f7bec153190 0x7f7bec073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.721+0000 7f7bf1d48640 1 --2- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 0x7f7bec0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.722+0000 7f7bf2d4a640 1 --2- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec0c61a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bec153570 tx=0x7f7be802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e5b8776fcc96af7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.722+0000 7f7bf1547640 1 -- 172.21.15.157:0/3220536628 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8037070 con 0x7f7bec0c7330 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.722+0000 7f7bf1547640 1 -- 172.21.15.157:0/3220536628 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be8032440 con 0x7f7bec0c7330 2024-04-25T12:49:49.722 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.722+0000 7f7bf1547640 1 -- 172.21.15.157:0/3220536628 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8032810 con 0x7f7bec0c7330 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 -- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 msgr2=0x7f7bec0c61a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec0c61a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7bec153570 tx=0x7f7be802a270 comp rx=0 tx=0).stop 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 -- 172.21.15.157:0/3220536628 shutdown_connections 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec0c61a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/3220536628 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec0c6f50 0x7f7bec0c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/3220536628 >> v2:172.21.15.132:3300/0 conn(0x7f7bec153190 0x7f7bec073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.725 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 -- 172.21.15.157:0/3220536628 >> 172.21.15.157:0/3220536628 conn(0x7f7bec075db0 msgr2=0x7f7bec067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 -- 172.21.15.157:0/3220536628 shutdown_connections 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.723+0000 7f7bf47ad640 1 -- 172.21.15.157:0/3220536628 wait complete. 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.724+0000 7f7bf47ad640 1 Processor -- start 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.724+0000 7f7bf47ad640 1 -- start start 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bec0c6f50 0x7f7bec1e4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 0x7f7bec15c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec159cd0 con 0x7f7bec0c6f50 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7bec1599f0 con 0x7f7bec0c7330 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7bec0cc9c0 con 0x7f7bec153190 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf1d48640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 0x7f7bec15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 0x7f7bec15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50496/0 (socket says 172.21.15.157:50496) 2024-04-25T12:49:49.726 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf1d48640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec15bb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45188/0 (socket says 172.21.15.157:45188) 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/4143860095 learned_addr learned my addr 172.21.15.157:0/4143860095 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2549640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bec0c6f50 0x7f7bec1e4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 msgr2=0x7f7bec15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/4143860095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bec0c6f50 msgr2=0x7f7bec1e4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bec0c6f50 0x7f7bec1e4b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 -- 172.21.15.157:0/4143860095 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bec15d300 con 0x7f7bec153190 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf1d48640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf2d4a640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 0x7f7bec15c070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7be80090b0 tx=0x7f7be80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8041020 con 0x7f7bec153190 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be803d640 con 0x7f7bec153190 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bec1ef140 con 0x7f7bec153190 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8037040 con 0x7f7bec153190 2024-04-25T12:49:49.727 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.725+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bec1ef700 con 0x7f7bec153190 2024-04-25T12:49:49.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.726+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7be8044020 con 0x7f7bec153190 2024-04-25T12:49:49.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.726+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7be8046c10 con 0x7f7bec153190 2024-04-25T12:49:49.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.726+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bec068d00 con 0x7f7bec153190 2024-04-25T12:49:49.728 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.728+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7be804b030 con 0x7f7bec153190 2024-04-25T12:49:49.796 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.798+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "20381eac-0560-48e6-8045-d8dfbb7a5b37", "id": 0} v 0) -- 0x7f7bec0c9e80 con 0x7f7bec153190 2024-04-25T12:49:49.800 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7be2ffd640 1 -- 172.21.15.157:0/4143860095 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "20381eac-0560-48e6-8045-d8dfbb7a5b37", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f7be8046400 con 0x7f7bec153190 2024-04-25T12:49:49.800 INFO:teuthology.orchestra.run.smithi157.stdout:0 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 msgr2=0x7f7bec15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 0x7f7bec15c070 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7be80090b0 tx=0x7f7be80046c0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 shutdown_connections 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bec153190 0x7f7bec15c070 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bec0c7330 0x7f7bec15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 --2- 172.21.15.157:0/4143860095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7bec0c6f50 0x7f7bec1e4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.801 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 >> 172.21.15.157:0/4143860095 conn(0x7f7bec075db0 msgr2=0x7f7bec157df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:49.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 shutdown_connections 2024-04-25T12:49:49.802 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.802+0000 7f7bf47ad640 1 -- 172.21.15.157:0/4143860095 wait complete. 2024-04-25T12:49:49.811 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new f746ae1e-b1e1-4f4c-9d19-b1436ab19a08 1 2024-04-25T12:49:49.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.911+0000 7f802048a640 1 Processor -- start 2024-04-25T12:49:49.909 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.911+0000 7f802048a640 1 -- start start 2024-04-25T12:49:49.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f802048a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f801813b8d0 0x7f8018073a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f802048a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80180c8560 0x7f80180c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f802048a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801813e2a0 con 0x7f80180c99e0 2024-04-25T12:49:49.911 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f802048a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f801813e540 con 0x7f801813b8d0 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f802048a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f801813e820 con 0x7f80180c8560 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80180c8560 0x7f80180c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f80180c8560 0x7f80180c89f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45212/0 (socket says 172.21.15.157:45212) 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 -- 172.21.15.157:0/3453125976 learned_addr learned my addr 172.21.15.157:0/3453125976 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801e226640 1 --2- 172.21.15.157:0/3453125976 >> v2:172.21.15.132:3300/0 conn(0x7f801813b8d0 0x7f8018073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 -- 172.21.15.157:0/3453125976 >> v2:172.21.15.132:3300/0 conn(0x7f801813b8d0 msgr2=0x7f8018073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 --2- 172.21.15.157:0/3453125976 >> v2:172.21.15.132:3300/0 conn(0x7f801813b8d0 0x7f8018073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 -- 172.21.15.157:0/3453125976 >> v1:172.21.15.157:6789/0 conn(0x7f80180c99e0 legacy=0x7f80181590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.912+0000 7f801da25640 1 -- 172.21.15.157:0/3453125976 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801813eb00 con 0x7f80180c8560 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.913+0000 7f801da25640 1 --2- 172.21.15.157:0/3453125976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80180c8560 0x7f80180c89f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f801806ed10 tx=0x7f800802a270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb1b1034ef40eb3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.913+0000 7f801d224640 1 -- 172.21.15.157:0/3453125976 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008037070 con 0x7f80180c8560 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.913+0000 7f801d224640 1 -- 172.21.15.157:0/3453125976 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8008032440 con 0x7f80180c8560 2024-04-25T12:49:49.912 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.913+0000 7f801d224640 1 -- 172.21.15.157:0/3453125976 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008032810 con 0x7f80180c8560 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 -- 172.21.15.157:0/3453125976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80180c8560 msgr2=0x7f80180c89f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 --2- 172.21.15.157:0/3453125976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80180c8560 0x7f80180c89f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f801806ed10 tx=0x7f800802a270 comp rx=0 tx=0).stop 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 -- 172.21.15.157:0/3453125976 shutdown_connections 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 --2- 172.21.15.157:0/3453125976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f80180c8560 0x7f80180c89f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 --2- 172.21.15.157:0/3453125976 >> v2:172.21.15.132:3300/0 conn(0x7f801813b8d0 0x7f8018073a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 -- 172.21.15.157:0/3453125976 >> 172.21.15.157:0/3453125976 conn(0x7f8018067630 msgr2=0x7f8018067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 -- 172.21.15.157:0/3453125976 shutdown_connections 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.914+0000 7f802048a640 1 -- 172.21.15.157:0/3453125976 wait complete. 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.915+0000 7f802048a640 1 Processor -- start 2024-04-25T12:49:49.916 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.915+0000 7f802048a640 1 -- start start 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f802048a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80180c8560 0x7f801806c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f802048a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80180c99e0 0x7f801813a270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f802048a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 0x7f80181e3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f802048a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f801813be30 con 0x7f80180c99e0 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f802048a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f801813bcb0 con 0x7f801813b8d0 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f802048a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f80181597b0 con 0x7f80180c8560 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80180c8560 0x7f801806c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801ea27640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 0x7f80181e3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801ea27640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 0x7f80181e3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45222/0 (socket says 172.21.15.157:45222) 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801ea27640 1 -- 172.21.15.157:0/733234124 learned_addr learned my addr 172.21.15.157:0/733234124 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801da25640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80180c99e0 0x7f801813a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 -- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 msgr2=0x7f80181e3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 0x7f80181e3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.917 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 -- 172.21.15.157:0/733234124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80180c99e0 msgr2=0x7f801813a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80180c99e0 0x7f801813a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 -- 172.21.15.157:0/733234124 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80180cbe10 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801ea27640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 0x7f80181e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801da25640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80180c99e0 0x7f801813a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.916+0000 7f801e226640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80180c8560 0x7f801806c340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f801400e8a0 tx=0x7f801400ed60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014017070 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f801400c940 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8014009e60 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80181e4d00 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f80181f4ba0 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f801401a070 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.917+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f801401c800 con 0x7f80180c8560 2024-04-25T12:49:49.918 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.918+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80180ce030 con 0x7f80180c8560 2024-04-25T12:49:49.919 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.920+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f801400cd60 con 0x7f80180c8560 2024-04-25T12:49:49.974 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:49.975+0000 7f0cb5398040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T12:49:49.991 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.993+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f746ae1e-b1e1-4f4c-9d19-b1436ab19a08", "id": 1} v 0) -- 0x7f8018071810 con 0x7f80180c8560 2024-04-25T12:49:49.996 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.998+0000 7f800effd640 1 -- 172.21.15.157:0/733234124 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f746ae1e-b1e1-4f4c-9d19-b1436ab19a08", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f801401cb20 con 0x7f80180c8560 2024-04-25T12:49:49.997 INFO:teuthology.orchestra.run.smithi157.stdout:1 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80180c8560 msgr2=0x7f801806c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80180c8560 0x7f801806c340 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f801400e8a0 tx=0x7f801400ed60 comp rx=0 tx=0).stop 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 shutdown_connections 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f801813b8d0 0x7f80181e3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80180c99e0 0x7f801813a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 --2- 172.21.15.157:0/733234124 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f80180c8560 0x7f801806c340 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 >> 172.21.15.157:0/733234124 conn(0x7f8018067630 msgr2=0x7f80180cd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 shutdown_connections 2024-04-25T12:49:49.998 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:49.999+0000 7f802048a640 1 -- 172.21.15.157:0/733234124 wait complete. 2024-04-25T12:49:50.008 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 37ad6072-e688-4038-9fd1-c375856716d1 2 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.109+0000 7f46efeef640 1 Processor -- start 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.110+0000 7f46efeef640 1 -- start start 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.110+0000 7f46efeef640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f46e8071e40 0x7f46e80c97e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.110+0000 7f46efeef640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 0x7f46e80c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.110+0000 7f46efeef640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e8072310 con 0x7f46e81522d0 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.110+0000 7f46efeef640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f46e81526b0 con 0x7f46e8071e40 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.110+0000 7f46efeef640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f46e815b9c0 con 0x7f46e80c82e0 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 0x7f46e80c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 0x7f46e80c9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50536/0 (socket says 172.21.15.157:50536) 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 -- 172.21.15.157:0/2184133061 learned_addr learned my addr 172.21.15.157:0/2184133061 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ed48a640 1 --2- 172.21.15.157:0/2184133061 >> v2:172.21.15.132:3300/0 conn(0x7f46e8071e40 0x7f46e80c97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 -- 172.21.15.157:0/2184133061 >> v2:172.21.15.132:3300/0 conn(0x7f46e8071e40 msgr2=0x7f46e80c97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:50.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 --2- 172.21.15.157:0/2184133061 >> v2:172.21.15.132:3300/0 conn(0x7f46e8071e40 0x7f46e80c97e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 -- 172.21.15.157:0/2184133061 >> v1:172.21.15.132:6789/0 conn(0x7f46e81522d0 legacy=0x7f46e815be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.111+0000 7f46ee48c640 1 -- 172.21.15.157:0/2184133061 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80725f0 con 0x7f46e80c82e0 2024-04-25T12:49:50.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46ee48c640 1 --2- 172.21.15.157:0/2184133061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 0x7f46e80c9d20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009e50 tx=0x7f46e002a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a463a54e826a7c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46ecc89640 1 -- 172.21.15.157:0/2184133061 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0036070 con 0x7f46e80c82e0 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46ecc89640 1 -- 172.21.15.157:0/2184133061 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e0031600 con 0x7f46e80c82e0 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46ecc89640 1 -- 172.21.15.157:0/2184133061 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e00319d0 con 0x7f46e80c82e0 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46efeef640 1 -- 172.21.15.157:0/2184133061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 msgr2=0x7f46e80c9d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46efeef640 1 --2- 172.21.15.157:0/2184133061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 0x7f46e80c9d20 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009e50 tx=0x7f46e002a710 comp rx=0 tx=0).stop 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46efeef640 1 -- 172.21.15.157:0/2184133061 shutdown_connections 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46efeef640 1 --2- 172.21.15.157:0/2184133061 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e80c82e0 0x7f46e80c9d20 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46efeef640 1 --2- 172.21.15.157:0/2184133061 >> v2:172.21.15.132:3300/0 conn(0x7f46e8071e40 0x7f46e80c97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.112+0000 7f46efeef640 1 -- 172.21.15.157:0/2184133061 >> 172.21.15.157:0/2184133061 conn(0x7f46e806b930 msgr2=0x7f46e806bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.113+0000 7f46efeef640 1 -- 172.21.15.157:0/2184133061 shutdown_connections 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.113+0000 7f46efeef640 1 -- 172.21.15.157:0/2184133061 wait complete. 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 Processor -- start 2024-04-25T12:49:50.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 -- start start 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46e8071e40 0x7f46e8144590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e80c82e0 0x7f46e81f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 0x7f46e80ca960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80c4a90 con 0x7f46e80c82e0 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f46e815b650 con 0x7f46e8071e40 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46efeef640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80c89f0 con 0x7f46e81522d0 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46ee48c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 0x7f46e80ca960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46edc8b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46e8071e40 0x7f46e8144590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46ee48c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 0x7f46e80ca960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50538/0 (socket says 172.21.15.157:50538) 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.114+0000 7f46ee48c640 1 -- 172.21.15.157:0/3736830357 learned_addr learned my addr 172.21.15.157:0/3736830357 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46ed48a640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e80c82e0 0x7f46e81f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46edc8b640 1 -- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 msgr2=0x7f46e80ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46edc8b640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 0x7f46e80ca960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.116 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46edc8b640 1 -- 172.21.15.157:0/3736830357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e80c82e0 msgr2=0x7f46e81f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46edc8b640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e80c82e0 0x7f46e81f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46edc8b640 1 -- 172.21.15.157:0/3736830357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e8157240 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46ee48c640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 0x7f46e80ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46ed48a640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e80c82e0 0x7f46e81f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46edc8b640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46e8071e40 0x7f46e8144590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46e4001680 tx=0x7f46e4001b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4001d30 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e40050d0 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e81564e0 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e4010630 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e81574e0 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f46e4010b60 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.115+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f46e4003a10 con 0x7f46e8071e40 2024-04-25T12:49:50.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.116+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e80741e0 con 0x7f46e8071e40 2024-04-25T12:49:50.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.118+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f46e4027080 con 0x7f46e8071e40 2024-04-25T12:49:50.151 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:50.153+0000 7f0cb5398040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:49:50.189 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.191+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "37ad6072-e688-4038-9fd1-c375856716d1", "id": 2} v 0) -- 0x7f46e8069330 con 0x7f46e8071e40 2024-04-25T12:49:50.195 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.197+0000 7f46de7fc640 1 -- 172.21.15.157:0/3736830357 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "37ad6072-e688-4038-9fd1-c375856716d1", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f46e40035f0 con 0x7f46e8071e40 2024-04-25T12:49:50.196 INFO:teuthology.orchestra.run.smithi157.stdout:2 2024-04-25T12:49:50.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46e8071e40 msgr2=0x7f46e8144590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46e8071e40 0x7f46e8144590 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f46e4001680 tx=0x7f46e4001b40 comp rx=0 tx=0).stop 2024-04-25T12:49:50.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 shutdown_connections 2024-04-25T12:49:50.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f46e81522d0 0x7f46e80ca960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e80c82e0 0x7f46e81f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 --2- 172.21.15.157:0/3736830357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f46e8071e40 0x7f46e8144590 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 >> 172.21.15.157:0/3736830357 conn(0x7f46e806b930 msgr2=0x7f46e8150440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 shutdown_connections 2024-04-25T12:49:50.198 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.198+0000 7f46efeef640 1 -- 172.21.15.157:0/3736830357 wait complete. 2024-04-25T12:49:50.207 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 7a35c236-6773-4df2-8b6d-7edf1d3181ad 3 2024-04-25T12:49:50.208 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:50.209+0000 7f0cb5398040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T12:49:50.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.307+0000 7fb387c10640 1 Processor -- start 2024-04-25T12:49:50.305 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.307+0000 7fb387c10640 1 -- start start 2024-04-25T12:49:50.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb387c10640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3800c82e0 0x7fb3800cd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb387c10640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3800cddb0 0x7fb38015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.307 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb387c10640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb380072090 con 0x7fb3800c78a0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb387c10640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb380071e40 con 0x7fb3800cddb0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb387c10640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb380072370 con 0x7fb3800c82e0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3800c82e0 0x7fb3800cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb3800c82e0 0x7fb3800cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45234/0 (socket says 172.21.15.157:45234) 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 -- 172.21.15.157:0/850653284 learned_addr learned my addr 172.21.15.157:0/850653284 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3859ac640 1 --1- 172.21.15.157:0/850653284 >> v1:172.21.15.157:6789/0 conn(0x7fb3800c78a0 0x7fb38015bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:45246/0 (socket says 172.21.15.157:45246) 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3861ad640 1 --2- 172.21.15.157:0/850653284 >> v2:172.21.15.132:3300/0 conn(0x7fb3800cddb0 0x7fb38015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 -- 172.21.15.157:0/850653284 >> v2:172.21.15.132:3300/0 conn(0x7fb3800cddb0 msgr2=0x7fb38015c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 --2- 172.21.15.157:0/850653284 >> v2:172.21.15.132:3300/0 conn(0x7fb3800cddb0 0x7fb38015c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 -- 172.21.15.157:0/850653284 >> v1:172.21.15.157:6789/0 conn(0x7fb3800c78a0 legacy=0x7fb38015bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.308+0000 7fb3851ab640 1 -- 172.21.15.157:0/850653284 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb380072650 con 0x7fb3800c82e0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.309+0000 7fb3851ab640 1 --2- 172.21.15.157:0/850653284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800c82e0 0x7fb3800cd870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3800ce720 tx=0x7fb37c02a300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36b88600bde9fab8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.309+0000 7fb3849aa640 1 -- 172.21.15.157:0/850653284 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c037070 con 0x7fb3800c82e0 2024-04-25T12:49:50.308 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.309+0000 7fb3849aa640 1 -- 172.21.15.157:0/850653284 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb37c02ae50 con 0x7fb3800c82e0 2024-04-25T12:49:50.309 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.309+0000 7fb3849aa640 1 -- 172.21.15.157:0/850653284 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c032860 con 0x7fb3800c82e0 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 -- 172.21.15.157:0/850653284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800c82e0 msgr2=0x7fb3800cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 --2- 172.21.15.157:0/850653284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800c82e0 0x7fb3800cd870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb3800ce720 tx=0x7fb37c02a300 comp rx=0 tx=0).stop 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 -- 172.21.15.157:0/850653284 shutdown_connections 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 --2- 172.21.15.157:0/850653284 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800c82e0 0x7fb3800cd870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 --2- 172.21.15.157:0/850653284 >> v2:172.21.15.132:3300/0 conn(0x7fb3800cddb0 0x7fb38015c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 -- 172.21.15.157:0/850653284 >> 172.21.15.157:0/850653284 conn(0x7fb38006b930 msgr2=0x7fb38006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.312 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 -- 172.21.15.157:0/850653284 shutdown_connections 2024-04-25T12:49:50.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.310+0000 7fb387c10640 1 -- 172.21.15.157:0/850653284 wait complete. 2024-04-25T12:49:50.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.311+0000 7fb387c10640 1 Processor -- start 2024-04-25T12:49:50.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.311+0000 7fb387c10640 1 -- start start 2024-04-25T12:49:50.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3800c78a0 0x7fb3800cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.313 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3800c82e0 0x7fb3801f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 0x7fb3801e8010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb380068080 con 0x7fb3800c78a0 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb380072c10 con 0x7fb3800cddb0 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb3800c8730 con 0x7fb3800c82e0 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 0x7fb3801e8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 0x7fb3801e8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45244/0 (socket says 172.21.15.157:45244) 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3851ab640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3800c82e0 0x7fb3801f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 -- 172.21.15.157:0/476467478 learned_addr learned my addr 172.21.15.157:0/476467478 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3859ac640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3800c78a0 0x7fb3800cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.314 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 -- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3800c82e0 msgr2=0x7fb3801f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3800c82e0 0x7fb3801f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 -- 172.21.15.157:0/476467478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3800c78a0 msgr2=0x7fb3800cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3800c78a0 0x7fb3800cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 -- 172.21.15.157:0/476467478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3801f0b80 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3861ad640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 0x7fb3801e8010 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb378007e90 tx=0x7fb37800e4b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378014420 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb378019070 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38015f2f0 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.312+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb378014800 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.313+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3801f0e00 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.313+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb3780149a0 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.313+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fb37801d850 con 0x7fb3800cddb0 2024-04-25T12:49:50.315 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.313+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3800741e0 con 0x7fb3800cddb0 2024-04-25T12:49:50.316 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.315+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb3801f0b80 con 0x7fb3800cddb0 2024-04-25T12:49:50.382 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.384+0000 7f6c30c12040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T12:49:50.386 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.388+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7a35c236-6773-4df2-8b6d-7edf1d3181ad", "id": 3} v 0) -- 0x7fb3800683f0 con 0x7fb3800cddb0 2024-04-25T12:49:50.391 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.393+0000 7fb3767fc640 1 -- 172.21.15.157:0/476467478 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7a35c236-6773-4df2-8b6d-7edf1d3181ad", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fb37801d3c0 con 0x7fb3800cddb0 2024-04-25T12:49:50.392 INFO:teuthology.orchestra.run.smithi157.stdout:3 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 msgr2=0x7fb3801e8010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 0x7fb3801e8010 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb378007e90 tx=0x7fb37800e4b0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 shutdown_connections 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb3800cddb0 0x7fb3801e8010 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb3800c82e0 0x7fb3801f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 --2- 172.21.15.157:0/476467478 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3800c78a0 0x7fb3800cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 >> 172.21.15.157:0/476467478 conn(0x7fb38006b930 msgr2=0x7fb3800cb820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 shutdown_connections 2024-04-25T12:49:50.393 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.394+0000 7fb387c10640 1 -- 172.21.15.157:0/476467478 wait complete. 2024-04-25T12:49:50.403 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new 62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b 4 2024-04-25T12:49:50.459 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:50.461+0000 7f0cb5398040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T12:49:50.468 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.470+0000 7f6c30c12040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T12:49:50.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.502+0000 7f55a0859640 1 Processor -- start 2024-04-25T12:49:50.501 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.502+0000 7f55a0859640 1 -- start start 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f55a0859640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f559c0ca880 0x7f559c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f55a0859640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f55a0859640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f559c0c9750 con 0x7f559c152280 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f55a0859640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f559c158f60 con 0x7f559c0ca880 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f55a0859640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f559c1581a0 con 0x7f559c0c8540 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f5593fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f559c0ca880 0x7f559c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f559ad9d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f5593fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f559c0ca880 0x7f559c0cb530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45250/0 (socket says 172.21.15.157:45250) 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.503+0000 7f5593fff640 1 -- 172.21.15.157:0/402984681 learned_addr learned my addr 172.21.15.157:0/402984681 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.502 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5593fff640 1 -- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 msgr2=0x7f559c0cba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5593fff640 1 --2- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c0cba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5593fff640 1 -- 172.21.15.157:0/402984681 >> v1:172.21.15.132:6789/0 conn(0x7f559c152280 legacy=0x7f559c15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.503 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5593fff640 1 -- 172.21.15.157:0/402984681 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c158480 con 0x7f559c0ca880 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5593fff640 1 --2- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c0ca880 0x7f559c0cb530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5584009870 tx=0x7f558402c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb6067475ebb34be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5599d9b640 1 -- 172.21.15.157:0/402984681 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584038070 con 0x7f559c0ca880 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5599d9b640 1 -- 172.21.15.157:0/402984681 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5584031710 con 0x7f559c0ca880 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.504+0000 7f5599d9b640 1 -- 172.21.15.157:0/402984681 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5584031ae0 con 0x7f559c0ca880 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 -- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c0ca880 msgr2=0x7f559c0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 --2- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c0ca880 0x7f559c0cb530 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5584009870 tx=0x7f558402c510 comp rx=0 tx=0).stop 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 -- 172.21.15.157:0/402984681 shutdown_connections 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 --2- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c0cba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 --2- 172.21.15.157:0/402984681 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c0ca880 0x7f559c0cb530 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.504 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 -- 172.21.15.157:0/402984681 >> 172.21.15.157:0/402984681 conn(0x7f559c06b930 msgr2=0x7f559c06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 -- 172.21.15.157:0/402984681 shutdown_connections 2024-04-25T12:49:50.505 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.505+0000 7f55a0859640 1 -- 172.21.15.157:0/402984681 wait complete. 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.506+0000 7f55a0859640 1 Processor -- start 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.506+0000 7f55a0859640 1 -- start start 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f55a0859640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c142ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f55a0859640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f559c0ca880 0x7f559c148a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f55a0859640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c152280 0x7f559c148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f55a0859640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f559c152660 con 0x7f559c0ca880 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f55a0859640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f559c158a40 con 0x7f559c152280 2024-04-25T12:49:50.507 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f55a0859640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f559c0c47d0 con 0x7f559c0c8540 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f559a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c142ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f559ad9d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c152280 0x7f559c148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f559a59c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c142ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50558/0 (socket says 172.21.15.157:50558) 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f559a59c640 1 -- 172.21.15.157:0/2562024773 learned_addr learned my addr 172.21.15.157:0/2562024773 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.507+0000 7f5593fff640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f559c0ca880 0x7f559c148a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559ad9d640 1 -- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 msgr2=0x7f559c142ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559ad9d640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c142ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559ad9d640 1 -- 172.21.15.157:0/2562024773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f559c0ca880 msgr2=0x7f559c148a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559ad9d640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f559c0ca880 0x7f559c148a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559ad9d640 1 -- 172.21.15.157:0/2562024773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c1e2960 con 0x7f559c152280 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559a59c640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f559ad9d640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c152280 0x7f559c148f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5594009d90 tx=0x7f559400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594018020 con 0x7f559c152280 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5594014480 con 0x7f559c152280 2024-04-25T12:49:50.508 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594014870 con 0x7f559c152280 2024-04-25T12:49:50.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c143240 con 0x7f559c152280 2024-04-25T12:49:50.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c155cc0 con 0x7f559c152280 2024-04-25T12:49:50.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5594005d10 con 0x7f559c152280 2024-04-25T12:49:50.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.508+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f55940138f0 con 0x7f559c152280 2024-04-25T12:49:50.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.509+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c0741e0 con 0x7f559c152280 2024-04-25T12:49:50.509 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:50.510+0000 7f0cb5398040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T12:49:50.509 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.511+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5594022030 con 0x7f559c152280 2024-04-25T12:49:50.510 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.512+0000 7f6c30c12040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T12:49:50.582 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.583+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b", "id": 4} v 0) -- 0x7f559c0c9110 con 0x7f559c152280 2024-04-25T12:49:50.586 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.588+0000 7f5592ffd640 1 -- 172.21.15.157:0/2562024773 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f559c1e2960 con 0x7f559c152280 2024-04-25T12:49:50.587 INFO:teuthology.orchestra.run.smithi157.stdout:4 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c152280 msgr2=0x7f559c148f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c152280 0x7f559c148f80 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f5594009d90 tx=0x7f559400c490 comp rx=0 tx=0).stop 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 shutdown_connections 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f559c152280 0x7f559c148f80 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f559c0ca880 0x7f559c148a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 --2- 172.21.15.157:0/2562024773 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f559c0c8540 0x7f559c142ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 >> 172.21.15.157:0/2562024773 conn(0x7f559c06b930 msgr2=0x7f559c06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 shutdown_connections 2024-04-25T12:49:50.588 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.589+0000 7f55a0859640 1 -- 172.21.15.157:0/2562024773 wait complete. 2024-04-25T12:49:50.598 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f 5 2024-04-25T12:49:50.676 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.677+0000 7f6c30c12040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T12:49:50.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.697+0000 7fedf3c2c640 1 Processor -- start 2024-04-25T12:49:50.695 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.697+0000 7fedf3c2c640 1 -- start start 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf3c2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fedec0c9ee0 0x7fedec06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf3c2c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec06be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf3c2c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0c9c00 con 0x7fedec152230 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf3c2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fedec0cf440 con 0x7fedec0c9ee0 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf3c2c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fedec0c9640 con 0x7fedec0731d0 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf21c9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec06be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf19c8640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fedec152230 0x7fedec15b1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.157:45252/0 (socket says 172.21.15.157:45252) 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf19c8640 1 -- 172.21.15.157:0/2535771726 learned_addr learned my addr 172.21.15.157:0/2535771726 (peer_addr_for_me v1:172.21.15.157:0/0) 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf11c7640 1 --2- 172.21.15.157:0/2535771726 >> v2:172.21.15.132:3300/0 conn(0x7fedec0c9ee0 0x7fedec06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.697 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf21c9640 1 -- 172.21.15.157:0/2535771726 >> v2:172.21.15.132:3300/0 conn(0x7fedec0c9ee0 msgr2=0x7fedec06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf21c9640 1 --2- 172.21.15.157:0/2535771726 >> v2:172.21.15.132:3300/0 conn(0x7fedec0c9ee0 0x7fedec06b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf09c6640 1 -- 172.21.15.157:0/2535771726 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2929537514 0 0) 0x7fedec0c9c00 con 0x7fedec152230 2024-04-25T12:49:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf21c9640 1 -- 172.21.15.157:0/2535771726 >> v1:172.21.15.157:6789/0 conn(0x7fedec152230 legacy=0x7fedec15b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf21c9640 1 -- 172.21.15.157:0/2535771726 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0c9920 con 0x7fedec0731d0 2024-04-25T12:49:50.698 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.698+0000 7fedf11c7640 1 --2- 172.21.15.157:0/2535771726 >> v2:172.21.15.132:3300/0 conn(0x7fedec0c9ee0 0x7fedec06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:49:50.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.699+0000 7fedf21c9640 1 --2- 172.21.15.157:0/2535771726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec06be70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fede4009d90 tx=0x7fede402a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7561b806ef96d7b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.699+0000 7fedf09c6640 1 -- 172.21.15.157:0/2535771726 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4007740 con 0x7fedec0731d0 2024-04-25T12:49:50.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.699+0000 7fedf09c6640 1 -- 172.21.15.157:0/2535771726 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fede40078e0 con 0x7fedec0731d0 2024-04-25T12:49:50.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.699+0000 7fedf09c6640 1 -- 172.21.15.157:0/2535771726 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4007cb0 con 0x7fedec0731d0 2024-04-25T12:49:50.699 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 -- 172.21.15.157:0/2535771726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 msgr2=0x7fedec06be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/2535771726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec06be70 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fede4009d90 tx=0x7fede402a6f0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 -- 172.21.15.157:0/2535771726 shutdown_connections 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/2535771726 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec06be70 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/2535771726 >> v2:172.21.15.132:3300/0 conn(0x7fedec0c9ee0 0x7fedec06b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 -- 172.21.15.157:0/2535771726 >> 172.21.15.157:0/2535771726 conn(0x7fedec067d10 msgr2=0x7fedec06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 -- 172.21.15.157:0/2535771726 shutdown_connections 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.700+0000 7fedf3c2c640 1 -- 172.21.15.157:0/2535771726 wait complete. 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.701+0000 7fedf3c2c640 1 Processor -- start 2024-04-25T12:49:50.700 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.701+0000 7fedf3c2c640 1 -- start start 2024-04-25T12:49:50.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf3c2c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.702 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf3c2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec0c9ee0 0x7fedec1578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf3c2c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedec152230 0x7fedec1f14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf3c2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fedec073710 con 0x7fedec0c9ee0 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf3c2c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0cef20 con 0x7fedec152230 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf3c2c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fedec15b8f0 con 0x7fedec0731d0 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec1568b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50576/0 (socket says 172.21.15.157:50576) 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf21c9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedec152230 0x7fedec1f14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 -- 172.21.15.157:0/1081587845 learned_addr learned my addr 172.21.15.157:0/1081587845 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf11c7640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec0c9ee0 0x7fedec1578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 -- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedec152230 msgr2=0x7fedec1f14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedec152230 0x7fedec1f14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 -- 172.21.15.157:0/1081587845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec0c9ee0 msgr2=0x7fedec1578a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec0c9ee0 0x7fedec1578a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 -- 172.21.15.157:0/1081587845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec155b30 con 0x7fedec0731d0 2024-04-25T12:49:50.703 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf21c9640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedec152230 0x7fedec1f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fedf19c8640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec1568b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c430 tx=0x7feddc00c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.702+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc0074e0 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feddc0047e0 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec156f50 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feddc004bd0 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec155dd0 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7feddc011070 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7feddc004d70 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.703+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec0741e0 con 0x7fedec0731d0 2024-04-25T12:49:50.704 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.705+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7feddc01d3f0 con 0x7fedec0731d0 2024-04-25T12:49:50.723 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.725+0000 7f6c30c12040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T12:49:50.774 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.776+0000 7f6c30c12040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T12:49:50.776 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.778+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f", "id": 5} v 0) -- 0x7fedec0c5820 con 0x7fedec0731d0 2024-04-25T12:49:50.781 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.783+0000 7fede27fc640 1 -- 172.21.15.157:0/1081587845 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7feddc01d5d0 con 0x7fedec0731d0 2024-04-25T12:49:50.782 INFO:teuthology.orchestra.run.smithi157.stdout:5 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 msgr2=0x7fedec1568b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec1568b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7feddc00c430 tx=0x7feddc00c8f0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 shutdown_connections 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fedec152230 0x7fedec1f14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedec0c9ee0 0x7fedec1578a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 --2- 172.21.15.157:0/1081587845 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fedec0731d0 0x7fedec1568b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.784+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 >> 172.21.15.157:0/1081587845 conn(0x7fedec067d10 msgr2=0x7fedec0cd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.785+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 shutdown_connections 2024-04-25T12:49:50.783 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.785+0000 7fedf3c2c640 1 -- 172.21.15.157:0/1081587845 wait complete. 2024-04-25T12:49:50.793 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new a7ef4cde-4203-4769-a7c0-ffac4530418b 6 2024-04-25T12:49:50.886 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:50.888+0000 7f6c30c12040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:49:50.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.894+0000 7fa7757a1640 1 Processor -- start 2024-04-25T12:49:50.892 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.894+0000 7fa7757a1640 1 -- start start 2024-04-25T12:49:50.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa7757a1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7700c7050 0x7fa7700704c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.894 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa7757a1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa7700cd280 0x7fa770152e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.897 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa7757a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7700c80d0 con 0x7fa7700c7430 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa7757a1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa7700701f0 con 0x7fa7700c7050 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa7757a1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa77006fd60 con 0x7fa7700cd280 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa7700cd280 0x7fa770152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa7700cd280 0x7fa770152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45268/0 (socket says 172.21.15.157:45268) 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 -- 172.21.15.157:0/756900009 learned_addr learned my addr 172.21.15.157:0/756900009 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76effd640 1 --2- 172.21.15.157:0/756900009 >> v2:172.21.15.132:3300/0 conn(0x7fa7700c7050 0x7fa7700704c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 -- 172.21.15.157:0/756900009 >> v2:172.21.15.132:3300/0 conn(0x7fa7700c7050 msgr2=0x7fa7700704c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 --2- 172.21.15.157:0/756900009 >> v2:172.21.15.132:3300/0 conn(0x7fa7700c7050 0x7fa7700704c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 -- 172.21.15.157:0/756900009 >> v1:172.21.15.132:6789/0 conn(0x7fa7700c7430 legacy=0x7fa770158fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.895+0000 7fa76f7fe640 1 -- 172.21.15.157:0/756900009 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7700c8370 con 0x7fa7700cd280 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.896+0000 7fa76f7fe640 1 --2- 172.21.15.157:0/756900009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa770152e70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa77006f1e0 tx=0x7fa76802a730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f7f9d4be861bdee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.896+0000 7fa76dffb640 1 -- 172.21.15.157:0/756900009 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768036070 con 0x7fa7700cd280 2024-04-25T12:49:50.898 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.896+0000 7fa76dffb640 1 -- 172.21.15.157:0/756900009 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768031600 con 0x7fa7700cd280 2024-04-25T12:49:50.899 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.896+0000 7fa76dffb640 1 -- 172.21.15.157:0/756900009 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680319d0 con 0x7fa7700cd280 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 -- 172.21.15.157:0/756900009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 msgr2=0x7fa770152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 --2- 172.21.15.157:0/756900009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa770152e70 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa77006f1e0 tx=0x7fa76802a730 comp rx=0 tx=0).stop 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 -- 172.21.15.157:0/756900009 shutdown_connections 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 --2- 172.21.15.157:0/756900009 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa770152e70 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 --2- 172.21.15.157:0/756900009 >> v2:172.21.15.132:3300/0 conn(0x7fa7700c7050 0x7fa7700704c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 -- 172.21.15.157:0/756900009 >> 172.21.15.157:0/756900009 conn(0x7fa77006b930 msgr2=0x7fa77006bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 -- 172.21.15.157:0/756900009 shutdown_connections 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.897+0000 7fa7757a1640 1 -- 172.21.15.157:0/756900009 wait complete. 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.898+0000 7fa7757a1640 1 Processor -- start 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.898+0000 7fa7757a1640 1 -- start start 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7700c7050 0x7fa7701ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.902 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7700c7430 0x7fa77015a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa7701557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700caa40 con 0x7fa7700c7050 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa7700c8630 con 0x7fa7700cd280 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa7700cad20 con 0x7fa7700c7430 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa7701557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76e7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7700c7430 0x7fa77015a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa7701557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45272/0 (socket says 172.21.15.157:45272) 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 -- 172.21.15.157:0/3037107160 learned_addr learned my addr 172.21.15.157:0/3037107160 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76effd640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7700c7050 0x7fa7701ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 -- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7700c7430 msgr2=0x7fa77015a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7700c7430 0x7fa77015a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 -- 172.21.15.157:0/3037107160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7700c7050 msgr2=0x7fa7701ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7700c7050 0x7fa7701ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.903 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 -- 172.21.15.157:0/3037107160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7701e5e90 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76e7fc640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7700c7430 0x7fa77015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa76f7fe640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa7701557b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa768009e20 tx=0x7fa768004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768036050 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa768042070 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7701e6170 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.899+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768009510 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.900+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa770154cd0 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.900+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa768007bb0 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.900+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fa768047aa0 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.900+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7700741e0 con 0x7fa7700cd280 2024-04-25T12:49:50.904 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.902+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa768047460 con 0x7fa7700cd280 2024-04-25T12:49:50.974 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.976+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a7ef4cde-4203-4769-a7c0-ffac4530418b", "id": 6} v 0) -- 0x7fa7700c8ac0 con 0x7fa7700cd280 2024-04-25T12:49:50.980 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.981+0000 7fa7677fe640 1 -- 172.21.15.157:0/3037107160 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a7ef4cde-4203-4769-a7c0-ffac4530418b", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fa768047640 con 0x7fa7700cd280 2024-04-25T12:49:50.980 INFO:teuthology.orchestra.run.smithi157.stdout:6 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 msgr2=0x7fa7701557b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa7701557b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa768009e20 tx=0x7fa768004a40 comp rx=0 tx=0).stop 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 shutdown_connections 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7700cd280 0x7fa7701557b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7700c7430 0x7fa77015a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 --2- 172.21.15.157:0/3037107160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7700c7050 0x7fa7701ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 >> 172.21.15.157:0/3037107160 conn(0x7fa77006b930 msgr2=0x7fa770072330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:50.981 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 shutdown_connections 2024-04-25T12:49:50.982 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:50.982+0000 7fa7757a1640 1 -- 172.21.15.157:0/3037107160 wait complete. 2024-04-25T12:49:50.991 DEBUG:teuthology.orchestra.run.smithi157:> sudo ceph --cluster ceph osd new efff5515-7f38-428f-a888-d31e59c40d96 7 2024-04-25T12:49:51.110 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.112+0000 7f3f575f0640 1 Processor -- start 2024-04-25T12:49:51.111 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.112+0000 7f3f575f0640 1 -- start start 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f575f0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f500702d0 0x7f3f50072820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f575f0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f50067ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f575f0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5015ea70 con 0x7f3f500c7ac0 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f575f0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3f50072d60 con 0x7f3f500702d0 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f575f0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3f5015ed50 con 0x7f3f50067630 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f55b8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f50067ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f54b8b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f500702d0 0x7f3f50072820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f54b8b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3f500702d0 0x7f3f50072820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.157:45284/0 (socket says 172.21.15.157:45284) 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f55b8d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f50067ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50586/0 (socket says 172.21.15.157:50586) 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.113+0000 7f3f54b8b640 1 -- 172.21.15.157:0/159253350 learned_addr learned my addr 172.21.15.157:0/159253350 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:51.112 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f55b8d640 1 -- 172.21.15.157:0/159253350 >> v2:172.21.15.157:3300/0 conn(0x7f3f500702d0 msgr2=0x7f3f50072820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:51.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f55b8d640 1 --2- 172.21.15.157:0/159253350 >> v2:172.21.15.157:3300/0 conn(0x7f3f500702d0 0x7f3f50072820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f55b8d640 1 -- 172.21.15.157:0/159253350 >> v1:172.21.15.157:6789/0 conn(0x7f3f500c7ac0 legacy=0x7f3f5006fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.113 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f55b8d640 1 -- 172.21.15.157:0/159253350 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5015f030 con 0x7f3f50067630 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f55b8d640 1 --2- 172.21.15.157:0/159253350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f50067ac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009d90 tx=0x7f3f4802a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76b5c0c8d232571d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f47fff640 1 -- 172.21.15.157:0/159253350 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48007740 con 0x7f3f50067630 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f47fff640 1 -- 172.21.15.157:0/159253350 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f480078e0 con 0x7f3f50067630 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.114+0000 7f3f47fff640 1 -- 172.21.15.157:0/159253350 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48007cb0 con 0x7f3f50067630 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 -- 172.21.15.157:0/159253350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 msgr2=0x7f3f50067ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 --2- 172.21.15.157:0/159253350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f50067ac0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009d90 tx=0x7f3f4802a660 comp rx=0 tx=0).stop 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 -- 172.21.15.157:0/159253350 shutdown_connections 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 --2- 172.21.15.157:0/159253350 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f50067ac0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.114 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 --2- 172.21.15.157:0/159253350 >> v2:172.21.15.157:3300/0 conn(0x7f3f500702d0 0x7f3f50072820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 -- 172.21.15.157:0/159253350 >> 172.21.15.157:0/159253350 conn(0x7f3f500ca340 msgr2=0x7f3f500ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:51.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 -- 172.21.15.157:0/159253350 shutdown_connections 2024-04-25T12:49:51.115 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.115+0000 7f3f575f0640 1 -- 172.21.15.157:0/159253350 wait complete. 2024-04-25T12:49:51.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.116+0000 7f3f575f0640 1 Processor -- start 2024-04-25T12:49:51.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.116+0000 7f3f575f0640 1 -- start start 2024-04-25T12:49:51.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f575f0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f501530d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f575f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f500702d0 0x7f3f5014c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.117 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f575f0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f500c7ac0 0x7f3f50153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f575f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3f500c8680 con 0x7f3f500702d0 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f575f0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3f5015f5f0 con 0x7f3f500c7ac0 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f575f0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3f500c8800 con 0x7f3f50067630 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f501530d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f55b8d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f500c7ac0 0x7f3f50153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f501530d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.157:50600/0 (socket says 172.21.15.157:50600) 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 -- 172.21.15.157:0/2847945035 learned_addr learned my addr 172.21.15.157:0/2847945035 (peer_addr_for_me v2:172.21.15.157:0/0) 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f54b8b640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f500702d0 0x7f3f5014c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 -- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f500c7ac0 msgr2=0x7f3f50153b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f500c7ac0 0x7f3f50153b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 -- 172.21.15.157:0/2847945035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f500702d0 msgr2=0x7f3f5014c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f500702d0 0x7f3f5014c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.118 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 -- 172.21.15.157:0/2847945035 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f501f41a0 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.117+0000 7f3f5538c640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f501530d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c3c0 tx=0x7f3f4000c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f400052d0 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f40005490 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f501f4480 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f40007260 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3f40007400 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f501f4a40 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.118+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f3f400035f0 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.119+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f500741e0 con 0x7f3f50067630 2024-04-25T12:49:51.119 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.121+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f3f40003b30 con 0x7f3f50067630 2024-04-25T12:49:51.192 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.194+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd new", "uuid": "efff5515-7f38-428f-a888-d31e59c40d96", "id": 7} v 0) -- 0x7f3f500c83f0 con 0x7f3f50067630 2024-04-25T12:49:51.197 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.199+0000 7f3f45ffb640 1 -- 172.21.15.157:0/2847945035 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "efff5515-7f38-428f-a888-d31e59c40d96", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f3f40003d10 con 0x7f3f50067630 2024-04-25T12:49:51.198 INFO:teuthology.orchestra.run.smithi157.stdout:7 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 msgr2=0x7f3f501530d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f501530d0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3f4000c3c0 tx=0x7f3f4000c880 comp rx=0 tx=0).stop 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 shutdown_connections 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3f500c7ac0 0x7f3f50153b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f500702d0 0x7f3f5014c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 --2- 172.21.15.157:0/2847945035 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3f50067630 0x7f3f501530d0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 >> 172.21.15.157:0/2847945035 conn(0x7f3f500ca340 msgr2=0x7f3f50155180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 shutdown_connections 2024-04-25T12:49:51.199 INFO:teuthology.orchestra.run.smithi157.stderr:2024-04-25T12:49:51.200+0000 7f3f575f0640 1 -- 172.21.15.157:0/2847945035 wait complete. 2024-04-25T12:49:51.209 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T12:49:51.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T12:49:51.211 INFO:tasks.ceph.osd.0:Started 2024-04-25T12:49:51.212 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T12:49:51.212 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T12:49:51.214 INFO:tasks.ceph.osd.1:Started 2024-04-25T12:49:51.214 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T12:49:51.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T12:49:51.216 INFO:tasks.ceph.osd.2:Started 2024-04-25T12:49:51.216 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T12:49:51.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T12:49:51.218 INFO:tasks.ceph.osd.3:Started 2024-04-25T12:49:51.218 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T12:49:51.219 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T12:49:51.222 INFO:tasks.ceph.osd.4:Started 2024-04-25T12:49:51.222 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T12:49:51.222 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T12:49:51.224 INFO:tasks.ceph.osd.5:Started 2024-04-25T12:49:51.224 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-25T12:49:51.224 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-25T12:49:51.226 INFO:tasks.ceph.osd.6:Started 2024-04-25T12:49:51.226 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-25T12:49:51.226 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-25T12:49:51.228 INFO:tasks.ceph.osd.7:Started 2024-04-25T12:49:51.229 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:49:51.273 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.274+0000 7f0cb5398040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T12:49:51.286 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:51.288+0000 7f6c30c12040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T12:49:51.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.352+0000 7f563277d640 1 Processor -- start 2024-04-25T12:49:51.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.352+0000 7f563277d640 1 -- start start 2024-04-25T12:49:51.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f563277d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c13bc00 0x7f562c0c6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f563277d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c159110 con 0x7f562c0c8970 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f563277d640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f562c1593f0 con 0x7f562c0c8530 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f563277d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f562c0c8e00 con 0x7f562c13bc00 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f5630d1a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f562c0c8970 0x7f562c15c640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60626/0 (socket says 172.21.15.132:60626) 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f5630d1a640 1 -- 172.21.15.132:0/2303017320 learned_addr learned my addr 172.21.15.132:0/2303017320 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562bfff640 1 --2- 172.21.15.132:0/2303017320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c13bc00 0x7f562c0c6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189310375 0 0) 0x7f562c159110 con 0x7f562c0c8970 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5614003520 con 0x7f562c0c8970 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344753963 0 0) 0x7f562c1593f0 con 0x7f562c0c8530 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f562c159110 con 0x7f562c0c8530 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562bfff640 1 -- 172.21.15.132:0/2303017320 >> v1:172.21.15.157:6789/0 conn(0x7f562c0c8530 legacy=0x7f562c0c98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562bfff640 1 -- 172.21.15.132:0/2303017320 >> v1:172.21.15.132:6789/0 conn(0x7f562c0c8970 legacy=0x7f562c15c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.353+0000 7f562bfff640 1 -- 172.21.15.132:0/2303017320 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c1596d0 con 0x7f562c13bc00 2024-04-25T12:49:51.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.354+0000 7f562bfff640 1 --2- 172.21.15.132:0/2303017320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c13bc00 0x7f562c0c6b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f56200097d0 tx=0x7f562002a050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ff71e3db1e9e0f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:51.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.354+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620037070 con 0x7f562c13bc00 2024-04-25T12:49:51.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.354+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f562002aae0 con 0x7f562c13bc00 2024-04-25T12:49:51.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.354+0000 7f562affd640 1 -- 172.21.15.132:0/2303017320 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56240019f0 con 0x7f562c13bc00 2024-04-25T12:49:51.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 -- 172.21.15.132:0/2303017320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c13bc00 msgr2=0x7f562c0c6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 --2- 172.21.15.132:0/2303017320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c13bc00 0x7f562c0c6b40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f56200097d0 tx=0x7f562002a050 comp rx=0 tx=0).stop 2024-04-25T12:49:51.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 -- 172.21.15.132:0/2303017320 shutdown_connections 2024-04-25T12:49:51.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 --2- 172.21.15.132:0/2303017320 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c13bc00 0x7f562c0c6b40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 -- 172.21.15.132:0/2303017320 >> 172.21.15.132:0/2303017320 conn(0x7f562c070c00 msgr2=0x7f562c071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 -- 172.21.15.132:0/2303017320 shutdown_connections 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.355+0000 7f563277d640 1 -- 172.21.15.132:0/2303017320 wait complete. 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.356+0000 7f563277d640 1 Processor -- start 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.356+0000 7f563277d640 1 -- start start 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f563277d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c0c8530 0x7f562c1ef630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f563277d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f562c0c8970 0x7f562c0ce600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f563277d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 0x7f562c1e2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f563277d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0c9fc0 con 0x7f562c13bc00 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f563277d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f562c0c9050 con 0x7f562c0c8970 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f563277d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f562c0ca140 con 0x7f562c0c8530 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f5630d1a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 0x7f562c1e2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f5630d1a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 0x7f562c1e2ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52466/0 (socket says 172.21.15.132:52466) 2024-04-25T12:49:51.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f5630d1a640 1 -- 172.21.15.132:0/3935319568 learned_addr learned my addr 172.21.15.132:0/3935319568 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562bfff640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c0c8530 0x7f562c1ef630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562b7fe640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f562c0c8970 0x7f562c0ce600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562bfff640 1 -- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f562c0c8970 msgr2=0x7f562c0ce600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562bfff640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f562c0c8970 0x7f562c0ce600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562bfff640 1 -- 172.21.15.132:0/3935319568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 msgr2=0x7f562c1e2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562bfff640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 0x7f562c1e2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f562bfff640 1 -- 172.21.15.132:0/3935319568 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f562c155db0 con 0x7f562c0c8530 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.357+0000 7f5630d1a640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 0x7f562c1e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f562bfff640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c0c8530 0x7f562c1ef630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f562c074150 tx=0x7f5620004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562004a070 con 0x7f562c0c8530 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620032440 con 0x7f562c0c8530 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f562c156090 con 0x7f562c0c8530 2024-04-25T12:49:51.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5620037040 con 0x7f562c0c8530 2024-04-25T12:49:51.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f562c156650 con 0x7f562c0c8530 2024-04-25T12:49:51.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f562004d070 con 0x7f562c0c8530 2024-04-25T12:49:51.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.358+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f5620045ac0 con 0x7f562c0c8530 2024-04-25T12:49:51.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.359+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562c0741e0 con 0x7f562c0c8530 2024-04-25T12:49:51.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.361+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5620032830 con 0x7f562c0c8530 2024-04-25T12:49:51.377 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.379+0000 7f0cb5398040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T12:49:51.419 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.421+0000 7f0cb5398040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T12:49:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.422+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f562c0c6800 con 0x7f562c0c8530 2024-04-25T12:49:51.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.423+0000 7f5628ff9640 1 -- 172.21.15.132:0/3935319568 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f5620032a10 con 0x7f562c0c8530 2024-04-25T12:49:51.421 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:49:51.421 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":10,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:49:51.196320+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:49:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.423+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c0c8530 msgr2=0x7f562c1ef630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.423+0000 7f563277d640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c0c8530 0x7f562c1ef630 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f562c074150 tx=0x7f5620004730 comp rx=0 tx=0).stop 2024-04-25T12:49:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 shutdown_connections 2024-04-25T12:49:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f562c13bc00 0x7f562c1e2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f562c0c8970 0x7f562c0ce600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 --2- 172.21.15.132:0/3935319568 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f562c0c8530 0x7f562c1ef630 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 >> 172.21.15.132:0/3935319568 conn(0x7f562c070c00 msgr2=0x7f562c13a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 shutdown_connections 2024-04-25T12:49:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:49:51.424+0000 7f563277d640 1 -- 172.21.15.132:0/3935319568 wait complete. 2024-04-25T12:49:51.433 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T12:49:51.433 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T12:49:51.560 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:51.562+0000 7f6c30c12040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T12:49:51.586 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.588+0000 7f0cb5398040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T12:49:51.614 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:51.616+0000 7f6c30c12040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T12:49:51.636 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.638+0000 7f0cb5398040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T12:49:51.688 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.690+0000 7f0cb5398040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T12:49:51.730 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:51.732+0000 7f6c30c12040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T12:49:51.801 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:51.803+0000 7f0cb5398040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T12:49:51.814 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-25T12:49:51.816+0000 7fcba769d640 -1 Falling back to public interface 2024-04-25T12:49:51.821 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-25T12:49:51.823+0000 7f9d968b3640 -1 Falling back to public interface 2024-04-25T12:49:51.822 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-25T12:49:51.824+0000 7fb64edd6640 -1 Falling back to public interface 2024-04-25T12:49:51.831 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-25T12:49:51.833+0000 7f4b670df640 -1 Falling back to public interface 2024-04-25T12:49:51.838 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-25T12:49:51.840+0000 7f90f1613640 -1 Falling back to public interface 2024-04-25T12:49:51.838 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-25T12:49:51.841+0000 7f9e419a3640 -1 Falling back to public interface 2024-04-25T12:49:51.843 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-25T12:49:51.845+0000 7fd63e486640 -1 Falling back to public interface 2024-04-25T12:49:51.844 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-25T12:49:51.846+0000 7fe0f2a11640 -1 Falling back to public interface 2024-04-25T12:49:52.009 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.011+0000 7f6c30c12040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T12:49:52.057 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.059+0000 7f6c30c12040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T12:49:52.187 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:52.189+0000 7f0cb5398040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-25T12:49:52.213 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.214+0000 7f6c30c12040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T12:49:52.239 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:49:52.329 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.331+0000 7fdfbc091640 1 Processor -- start 2024-04-25T12:49:52.329 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.331+0000 7fdfbc091640 1 -- start start 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfbc091640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb4073c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfbc091640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb406fb10 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfbc091640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb40c6200 con 0x7fdfb40c72e0 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfbc091640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb40cb4e0 con 0x7fdfb4155450 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb962c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdfb40c6ca0 0x7fdfb415bd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60634/0 (socket says 172.21.15.132:60634) 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb962c640 1 -- 172.21.15.132:0/101591396 learned_addr learned my addr 172.21.15.132:0/101591396 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb9e2d640 1 --2- 172.21.15.132:0/101591396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb4073c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:52.331 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 293998948 0 0) 0x7fdfb406fb10 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfa0003520 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243900982 0 0) 0x7fdfb40c6200 con 0x7fdfb40c72e0 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfb406fb10 con 0x7fdfb40c72e0 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/101591396 >> v1:172.21.15.157:6789/0 conn(0x7fdfb40c72e0 legacy=0x7fdfb4072ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.332+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/101591396 >> v1:172.21.15.132:6789/0 conn(0x7fdfb40c6ca0 legacy=0x7fdfb415bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.333+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 263139079 0 0) 0x7fdfa0003520 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.332 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.333+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/101591396 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb40caf40 con 0x7fdfb4155450 2024-04-25T12:49:52.336 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.333+0000 7fdfb9e2d640 1 --2- 172.21.15.132:0/101591396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb4073c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097d0 tx=0x7fdfa802a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70be6daf092dfd7a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:52.336 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.333+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8037070 con 0x7fdfb4155450 2024-04-25T12:49:52.336 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.333+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa802acc0 con 0x7fdfb4155450 2024-04-25T12:49:52.336 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.333+0000 7fdfb8e2b640 1 -- 172.21.15.132:0/101591396 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfb0001670 con 0x7fdfb4155450 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 -- 172.21.15.132:0/101591396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 msgr2=0x7fdfb4073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 --2- 172.21.15.132:0/101591396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb4073c20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fdfa80097d0 tx=0x7fdfa802a230 comp rx=0 tx=0).stop 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 -- 172.21.15.132:0/101591396 shutdown_connections 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 --2- 172.21.15.132:0/101591396 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb4073c20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 -- 172.21.15.132:0/101591396 >> 172.21.15.132:0/101591396 conn(0x7fdfb406ef10 msgr2=0x7fdfb406f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 -- 172.21.15.132:0/101591396 shutdown_connections 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.334+0000 7fdfbc091640 1 -- 172.21.15.132:0/101591396 wait complete. 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.335+0000 7fdfbc091640 1 Processor -- start 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.335+0000 7fdfbc091640 1 -- start start 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfbc091640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 0x7fdfb41f0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfbc091640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb40c72e0 0x7fdfb415bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfbc091640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb415e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:52.337 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfbc091640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb40c70a0 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfbc091640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb40c6810 con 0x7fdfb40c72e0 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfbc091640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdfb40c64a0 con 0x7fdfb4155450 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 0x7fdfb41f0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 0x7fdfb41f0fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52476/0 (socket says 172.21.15.132:52476) 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/4285545366 learned_addr learned my addr 172.21.15.132:0/4285545366 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfba62e640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb415e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb962c640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb40c72e0 0x7fdfb415bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 msgr2=0x7fdfb415e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb415e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb40c72e0 msgr2=0x7fdfb415bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb40c72e0 0x7fdfb415bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 -- 172.21.15.132:0/4285545366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb415f4b0 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.338 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.336+0000 7fdfb9e2d640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 0x7fdfb41f0fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8035040 tx=0x7fdfa80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8037050 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa8043070 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdfa8006e10 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb4150800 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb41f4a40 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fdfa803ca50 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.337+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fdfa803eb20 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.338+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb406fd10 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.339 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.340+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fdfb406fd10 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.354 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.356+0000 7f6c30c12040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T12:49:52.400 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.402+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdfb40741e0 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.401 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.402+0000 7fdfa67fc640 1 -- 172.21.15.132:0/4285545366 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fdfb40741e0 con 0x7fdfb40c6ca0 2024-04-25T12:49:52.401 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-25T12:49:52.401 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":10,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:49:51.196320+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 msgr2=0x7fdfb41f0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 0x7fdfb41f0fe0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8035040 tx=0x7fdfa80046c0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 shutdown_connections 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfb4155450 0x7fdfb415e990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfb40c72e0 0x7fdfb415bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 --2- 172.21.15.132:0/4285545366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfb40c6ca0 0x7fdfb41f0fe0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:52.402 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 >> 172.21.15.132:0/4285545366 conn(0x7fdfb406ef10 msgr2=0x7fdfb4153190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:52.403 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 shutdown_connections 2024-04-25T12:49:52.403 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:52.403+0000 7fdfbc091640 1 -- 172.21.15.132:0/4285545366 wait complete. 2024-04-25T12:49:52.405 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.407+0000 7f6c30c12040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T12:49:52.411 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-25T12:49:52.448 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:52.449+0000 7f0cb5398040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T12:49:52.477 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.479+0000 7f6c30c12040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T12:49:52.499 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:52.501+0000 7f0cb5398040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T12:49:52.521 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:52.523+0000 7f6c30c12040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T12:49:52.614 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:52.615+0000 7f0cb5398040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T12:49:52.892 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:52.894+0000 7f0cb5398040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T12:49:52.941 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:52.943+0000 7f0cb5398040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T12:49:52.998 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:53.000+0000 7f6c30c12040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T12:49:53.098 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:53.099+0000 7f0cb5398040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T12:49:53.114 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:53.116+0000 7f6c30c12040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T12:49:53.239 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:53.241+0000 7f0cb5398040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T12:49:53.288 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:53.290+0000 7f0cb5398040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T12:49:53.358 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:53.359+0000 7f0cb5398040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T12:49:53.403 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:53.405+0000 7f0cb5398040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T12:49:53.884 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:53.885+0000 7f0cb5398040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T12:49:54.000 INFO:tasks.ceph.mgr.x.smithi157.stderr:2024-04-25T12:49:54.001+0000 7f0cb5398040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T12:49:54.127 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:54.129+0000 7f6bd1390640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T12:49:54.128 INFO:tasks.ceph.mgr.y.smithi132.stderr:2024-04-25T12:49:54.130+0000 7f6bd1390640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T12:49:55.281 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-25T12:49:55.283+0000 7f4b670df640 -1 osd.0 0 log_to_monitors true 2024-04-25T12:49:55.333 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-25T12:49:55.335+0000 7f9d968b3640 -1 osd.1 0 log_to_monitors true 2024-04-25T12:49:55.339 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-25T12:49:55.339+0000 7fb64edd6640 -1 osd.7 0 log_to_monitors true 2024-04-25T12:49:55.343 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-25T12:49:55.345+0000 7f90f1613640 -1 osd.2 0 log_to_monitors true 2024-04-25T12:49:55.344 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-25T12:49:55.346+0000 7fcba769d640 -1 osd.5 0 log_to_monitors true 2024-04-25T12:49:55.347 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-25T12:49:55.350+0000 7fd63e486640 -1 osd.3 0 log_to_monitors true 2024-04-25T12:49:55.351 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-25T12:49:55.352+0000 7f9e419a3640 -1 osd.6 0 log_to_monitors true 2024-04-25T12:49:55.384 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-25T12:49:55.384+0000 7fe0f2a11640 -1 osd.4 0 log_to_monitors true 2024-04-25T12:49:58.479 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-25T12:49:58.478+0000 7f9e3d939640 -1 osd.6 0 waiting for initial osdmap 2024-04-25T12:49:58.486 INFO:tasks.ceph.osd.6.smithi157.stderr:2024-04-25T12:49:58.488+0000 7f9e35759640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:58.518 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-25T12:49:58.519+0000 7fe0ee28c640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T12:49:58.528 INFO:tasks.ceph.osd.4.smithi157.stderr:2024-04-25T12:49:58.530+0000 7fe0e60ac640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:58.548 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-25T12:49:58.550+0000 7fcba3633640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T12:49:58.559 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-25T12:49:58.561+0000 7fb64ad6c640 -1 osd.7 0 waiting for initial osdmap 2024-04-25T12:49:58.560 INFO:tasks.ceph.osd.5.smithi157.stderr:2024-04-25T12:49:58.562+0000 7fcb9b453640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:58.572 INFO:tasks.ceph.osd.7.smithi157.stderr:2024-04-25T12:49:58.574+0000 7fb642b8c640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:59.180 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-25T12:49:59.180+0000 7f90ecf04640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T12:49:59.199 INFO:tasks.ceph.osd.2.smithi132.stderr:2024-04-25T12:49:59.201+0000 7f90e4d24640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:59.240 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:49:59.255 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-25T12:49:59.257+0000 7fd63a41c640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T12:49:59.268 INFO:tasks.ceph.osd.3.smithi132.stderr:2024-04-25T12:49:59.270+0000 7fd63223c640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:59.273 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-25T12:49:59.275+0000 7f4b63075640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T12:49:59.277 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-25T12:49:59.279+0000 7f9d92849640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T12:49:59.287 INFO:tasks.ceph.osd.0.smithi132.stderr:2024-04-25T12:49:59.289+0000 7f4b5ae95640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:59.290 INFO:tasks.ceph.osd.1.smithi132.stderr:2024-04-25T12:49:59.292+0000 7f9d8a669640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.344+0000 7faf59e2c640 1 Processor -- start 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.344+0000 7faf59e2c640 1 -- start start 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf59e2c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8860 0x7faf54072f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf59e2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf540c8c40 0x7faf540734b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf59e2c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf540c6190 con 0x7faf5413b590 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf59e2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7faf5415d6b0 con 0x7faf540c8c40 2024-04-25T12:49:59.350 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf59e2c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faf540c6da0 con 0x7faf540c8860 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf540c8c40 0x7faf540734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf540c8c40 0x7faf540734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60914/0 (socket says 172.21.15.132:60914) 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 -- 172.21.15.132:0/1043716201 learned_addr learned my addr 172.21.15.132:0/1043716201 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf537fe640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8860 0x7faf54072f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 -- 172.21.15.132:0/1043716201 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8860 msgr2=0x7faf54072f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8860 0x7faf54072f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 -- 172.21.15.132:0/1043716201 >> v1:172.21.15.157:6789/0 conn(0x7faf5413b590 legacy=0x7faf5413b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf4bfff640 1 -- 172.21.15.132:0/1043716201 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540c6470 con 0x7faf540c8c40 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.345+0000 7faf537fe640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8860 0x7faf54072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.346+0000 7faf4bfff640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf540c8c40 0x7faf540734b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c02a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77a6c101eaf9938e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.346+0000 7faf52ffd640 1 -- 172.21.15.132:0/1043716201 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c037070 con 0x7faf540c8c40 2024-04-25T12:49:59.351 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.346+0000 7faf52ffd640 1 -- 172.21.15.132:0/1043716201 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf3c032440 con 0x7faf540c8c40 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.346+0000 7faf52ffd640 1 -- 172.21.15.132:0/1043716201 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf3c032810 con 0x7faf540c8c40 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 -- 172.21.15.132:0/1043716201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf540c8c40 msgr2=0x7faf540734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf540c8c40 0x7faf540734b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faf3c009870 tx=0x7faf3c02a210 comp rx=0 tx=0).stop 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 -- 172.21.15.132:0/1043716201 shutdown_connections 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf540c8c40 0x7faf540734b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 --2- 172.21.15.132:0/1043716201 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8860 0x7faf54072f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 -- 172.21.15.132:0/1043716201 >> 172.21.15.132:0/1043716201 conn(0x7faf5406ef10 msgr2=0x7faf5406f320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 -- 172.21.15.132:0/1043716201 shutdown_connections 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.347+0000 7faf59e2c640 1 -- 172.21.15.132:0/1043716201 wait complete. 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 Processor -- start 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 -- start start 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf540c8860 0x7faf541f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8c40 0x7faf540ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:59.352 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 0x7faf5415bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faf5415c760 con 0x7faf5413b590 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faf540c6a30 con 0x7faf540c8860 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf59e2c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faf5415c8e0 con 0x7faf540c8c40 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.348+0000 7faf53fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 0x7faf5415bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 0x7faf5415bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60930/0 (socket says 172.21.15.132:60930) 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 -- 172.21.15.132:0/102099558 learned_addr learned my addr 172.21.15.132:0/102099558 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf4bfff640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8c40 0x7faf540ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf537fe640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf540c8860 0x7faf541f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 -- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8c40 msgr2=0x7faf540ca520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8c40 0x7faf540ca520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 -- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf540c8860 msgr2=0x7faf541f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf540c8860 0x7faf541f2960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.353 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 -- 172.21.15.132:0/102099558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf540c9360 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf53fff640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 0x7faf5415bed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00b970 tx=0x7faf4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c019070 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf4c00cb40 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf540c9640 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf4c014440 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.349+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf541f1e80 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.350+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf54076370 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.350+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7faf4c01c070 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.351+0000 7faf50ff9640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faf3406c860 0x7faf3406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.351+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 3911+0+0 (secure 0 0 0) 0x7faf4c08aea0 con 0x7faf5413b590 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.351+0000 7faf537fe640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faf3406c860 0x7faf3406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:49:59.354 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.351+0000 7faf537fe640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faf3406c860 0x7faf3406ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf4400ab60 tx=0x7faf44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:49:59.355 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.355+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faf4c059460 con 0x7faf5413b590 2024-04-25T12:49:59.531 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.533+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faf5406ea90 con 0x7faf5413b590 2024-04-25T12:49:59.531 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.533+0000 7faf50ff9640 1 -- 172.21.15.132:0/102099558 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+9973 (secure 0 0 0) 0x7faf4c05d760 con 0x7faf5413b590 2024-04-25T12:49:59.532 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-25T12:49:59.532 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":13,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:49:59.281011+0000","last_up_change":"2024-04-25T12:49:59.281011+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faf3406c860 msgr2=0x7faf3406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faf3406c860 0x7faf3406ed20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faf4400ab60 tx=0x7faf44008040 comp rx=0 tx=0).stop 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 msgr2=0x7faf5415bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 0x7faf5415bed0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faf4c00b970 tx=0x7faf4c00be30 comp rx=0 tx=0).stop 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 shutdown_connections 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faf3406c860 0x7faf3406ed20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf5413b590 0x7faf5415bed0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.534 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faf540c8c40 0x7faf540ca520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.535 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 --2- 172.21.15.132:0/102099558 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faf540c8860 0x7faf541f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:49:59.535 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 >> 172.21.15.132:0/102099558 conn(0x7faf5406ef10 msgr2=0x7faf54151a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:49:59.535 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 shutdown_connections 2024-04-25T12:49:59.535 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:49:59.535+0000 7faf59e2c640 1 -- 172.21.15.132:0/102099558 wait complete. 2024-04-25T12:49:59.543 DEBUG:teuthology.misc:6 of 8 OSDs are up 2024-04-25T12:50:06.351 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:06.451 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.453+0000 7f717b2c2640 1 Processor -- start 2024-04-25T12:50:06.452 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.453+0000 7f717b2c2640 1 -- start start 2024-04-25T12:50:06.454 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717b2c2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f71740c8dc0 0x7f71740ccee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.454 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717b2c2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7174075520 0x7f71740c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717b2c2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f717415bce0 con 0x7f7174075140 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717b2c2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f717415bfc0 con 0x7f7174075520 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717b2c2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f71740cc400 con 0x7f71740c8dc0 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717985f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7174075520 0x7f71740c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717985f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7174075520 0x7f71740c7350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52590/0 (socket says 172.21.15.132:52590) 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717985f640 1 -- 172.21.15.132:0/1433351523 learned_addr learned my addr 172.21.15.132:0/1433351523 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717885d640 1 --2- 172.21.15.132:0/1433351523 >> v2:172.21.15.157:3300/0 conn(0x7f71740c8dc0 0x7f71740ccee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.454+0000 7f717985f640 1 -- 172.21.15.132:0/1433351523 >> v2:172.21.15.157:3300/0 conn(0x7f71740c8dc0 msgr2=0x7f71740ccee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:06.455 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f717985f640 1 --2- 172.21.15.132:0/1433351523 >> v2:172.21.15.157:3300/0 conn(0x7f71740c8dc0 0x7f71740ccee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f717985f640 1 -- 172.21.15.132:0/1433351523 >> v1:172.21.15.157:6789/0 conn(0x7f7174075140 legacy=0x7f717415b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f717985f640 1 -- 172.21.15.132:0/1433351523 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71740cc6e0 con 0x7f7174075520 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f717985f640 1 --2- 172.21.15.132:0/1433351523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7174075520 0x7f71740c7350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71740c4b50 tx=0x7f716402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c1556e949a55ced server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f7173fff640 1 -- 172.21.15.132:0/1433351523 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164037070 con 0x7f7174075520 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f7173fff640 1 -- 172.21.15.132:0/1433351523 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7164032440 con 0x7f7174075520 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.455+0000 7f7173fff640 1 -- 172.21.15.132:0/1433351523 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164032810 con 0x7f7174075520 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 -- 172.21.15.132:0/1433351523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7174075520 msgr2=0x7f71740c7350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 --2- 172.21.15.132:0/1433351523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7174075520 0x7f71740c7350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f71740c4b50 tx=0x7f716402a230 comp rx=0 tx=0).stop 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 -- 172.21.15.132:0/1433351523 shutdown_connections 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 --2- 172.21.15.132:0/1433351523 >> v2:172.21.15.157:3300/0 conn(0x7f71740c8dc0 0x7f71740ccee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 --2- 172.21.15.132:0/1433351523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7174075520 0x7f71740c7350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.456 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 -- 172.21.15.132:0/1433351523 >> 172.21.15.132:0/1433351523 conn(0x7f71740ca320 msgr2=0x7f71740ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:06.457 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 -- 172.21.15.132:0/1433351523 shutdown_connections 2024-04-25T12:50:06.457 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.456+0000 7f717b2c2640 1 -- 172.21.15.132:0/1433351523 wait complete. 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.457+0000 7f717b2c2640 1 Processor -- start 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.457+0000 7f717b2c2640 1 -- start start 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717b2c2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7174075140 0x7f7174152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717b2c2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7174075520 0x7f71740c0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717b2c2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 0x7f71740c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717b2c2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f71740cd420 con 0x7f71740c8dc0 2024-04-25T12:50:06.460 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717b2c2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f717415c2a0 con 0x7f7174075140 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717b2c2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f71740cd5a0 con 0x7f7174075520 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 0x7f71740c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 0x7f71740c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52598/0 (socket says 172.21.15.132:52598) 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 -- 172.21.15.132:0/3863545043 learned_addr learned my addr 172.21.15.132:0/3863545043 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717905e640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7174075140 0x7f7174152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717885d640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7174075520 0x7f71740c0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 -- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7174075520 msgr2=0x7f71740c0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7174075520 0x7f71740c0c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 -- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7174075140 msgr2=0x7f7174152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7174075140 0x7f7174152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.461 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 -- 172.21.15.132:0/3863545043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71740c4310 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717905e640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7174075140 0x7f7174152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717885d640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7174075520 0x7f71740c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f717985f640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 0x7f71740c31e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71640090b0 tx=0x7f71640046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.458+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164041020 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.459+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71640306c0 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.459+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71740c3df0 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.459+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7164037040 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.459+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71741f0ef0 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.460+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71741f0a00 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.460+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7164044020 con 0x7f71740c8dc0 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.461+0000 7f7171ffb640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f716006c8f0 0x7f716006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.462 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.461+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f71640abfc0 con 0x7f71740c8dc0 2024-04-25T12:50:06.463 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.461+0000 7f717905e640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f716006c8f0 0x7f716006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.463 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.461+0000 7f717905e640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f716006c8f0 0x7f716006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fc0 tx=0x7f716c009550 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:06.463 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.465+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f716404b030 con 0x7f71740c8dc0 2024-04-25T12:50:06.639 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.641+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7174076370 con 0x7f71740c8dc0 2024-04-25T12:50:06.640 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.641+0000 7f7171ffb640 1 -- 172.21.15.132:0/3863545043 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f71740c4310 con 0x7f71740c8dc0 2024-04-25T12:50:06.640 INFO:teuthology.misc.health.smithi132.stdout: 2024-04-25T12:50:06.640 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":17,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:03.303991+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.643+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f716006c8f0 msgr2=0x7f716006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.643+0000 7f717b2c2640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f716006c8f0 0x7f716006edb0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f716c009fc0 tx=0x7f716c009550 comp rx=0 tx=0).stop 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.643+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 msgr2=0x7f71740c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.643+0000 7f717b2c2640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 0x7f71740c31e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f71640090b0 tx=0x7f71640046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.643+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 shutdown_connections 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f716006c8f0 0x7f716006edb0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.642 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71740c8dc0 0x7f71740c31e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.643 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7174075520 0x7f71740c0c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.643 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 --2- 172.21.15.132:0/3863545043 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7174075140 0x7f7174152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.643 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 >> 172.21.15.132:0/3863545043 conn(0x7f71740ca320 msgr2=0x7f71740c5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:06.643 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 shutdown_connections 2024-04-25T12:50:06.643 INFO:teuthology.misc.health.smithi132.stderr:2024-04-25T12:50:06.644+0000 7f717b2c2640 1 -- 172.21.15.132:0/3863545043 wait complete. 2024-04-25T12:50:06.652 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-25T12:50:06.652 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T12:50:06.652 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T12:50:06.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T12:50:06.655 INFO:tasks.ceph.mds.a:Started 2024-04-25T12:50:06.655 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T12:50:06.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T12:50:06.657 INFO:tasks.ceph.mds.c:Started 2024-04-25T12:50:06.657 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-25T12:50:06.657 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-25T12:50:06.659 INFO:tasks.ceph.mds.e:Started 2024-04-25T12:50:06.659 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T12:50:06.659 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T12:50:06.662 INFO:tasks.ceph.mds.b:Started 2024-04-25T12:50:06.662 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-25T12:50:06.663 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-25T12:50:06.665 INFO:tasks.ceph.mds.d:Started 2024-04-25T12:50:06.666 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-25T12:50:06.666 DEBUG:teuthology.orchestra.run.smithi157:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-25T12:50:06.669 INFO:tasks.ceph.mds.f:Started 2024-04-25T12:50:06.669 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T12:50:06.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:06.731 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2024-04-25T12:50:06.731 INFO:tasks.ceph.mds.e.smithi132.stdout:starting mds.e at 2024-04-25T12:50:06.732 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2024-04-25T12:50:06.747 INFO:tasks.ceph.mds.d.smithi157.stdout:starting mds.d at 2024-04-25T12:50:06.749 INFO:tasks.ceph.mds.b.smithi157.stdout:starting mds.b at 2024-04-25T12:50:06.753 INFO:tasks.ceph.mds.f.smithi157.stdout:starting mds.f at 2024-04-25T12:50:06.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.778+0000 7f3b3c707640 1 Processor -- start 2024-04-25T12:50:06.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.778+0000 7f3b3c707640 1 -- start start 2024-04-25T12:50:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.778+0000 7f3b3c707640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b340678a0 0x7f3b34152d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3c707640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b34159090 con 0x7f3b3415cff0 2024-04-25T12:50:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3c707640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b34159330 con 0x7f3b34067c80 2024-04-25T12:50:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3c707640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f3b34159eb0 con 0x7f3b340678a0 2024-04-25T12:50:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3a4a3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b340678a0 0x7f3b34152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3aca4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3b3415cff0 0x7f3b340c4b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40282/0 (socket says 172.21.15.132:40282) 2024-04-25T12:50:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3aca4640 1 -- 172.21.15.132:0/795722144 learned_addr learned my addr 172.21.15.132:0/795722144 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3a4a3640 1 -- 172.21.15.132:0/795722144 >> v1:172.21.15.157:6789/0 conn(0x7f3b34067c80 legacy=0x7f3b3415c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3a4a3640 1 -- 172.21.15.132:0/795722144 >> v1:172.21.15.132:6789/0 conn(0x7f3b3415cff0 legacy=0x7f3b340c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.779+0000 7f3b3a4a3640 1 -- 172.21.15.132:0/795722144 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b34159610 con 0x7f3b340678a0 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3a4a3640 1 --2- 172.21.15.132:0/795722144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b340678a0 0x7f3b34152d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009800 tx=0x7f3b3002a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be0fc78f83b0ee20 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b394a1640 1 -- 172.21.15.132:0/795722144 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30037070 con 0x7f3b340678a0 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b394a1640 1 -- 172.21.15.132:0/795722144 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b30032440 con 0x7f3b340678a0 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b394a1640 1 -- 172.21.15.132:0/795722144 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b30032810 con 0x7f3b340678a0 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 -- 172.21.15.132:0/795722144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b340678a0 msgr2=0x7f3b34152d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 --2- 172.21.15.132:0/795722144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b340678a0 0x7f3b34152d30 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3b30009800 tx=0x7f3b3002a200 comp rx=0 tx=0).stop 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 -- 172.21.15.132:0/795722144 shutdown_connections 2024-04-25T12:50:06.779 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 --2- 172.21.15.132:0/795722144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b340678a0 0x7f3b34152d30 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 -- 172.21.15.132:0/795722144 >> 172.21.15.132:0/795722144 conn(0x7f3b3406b930 msgr2=0x7f3b3406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 -- 172.21.15.132:0/795722144 shutdown_connections 2024-04-25T12:50:06.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.780+0000 7f3b3c707640 1 -- 172.21.15.132:0/795722144 wait complete. 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.781+0000 7f3b3c707640 1 Processor -- start 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.781+0000 7f3b3c707640 1 -- start start 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3c707640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b340678a0 0x7f3b34144920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3c707640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b34067c80 0x7f3b3415a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3c707640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 0x7f3b341f09e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3c707640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3b340704f0 con 0x7f3b3415cff0 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3c707640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3b34159bd0 con 0x7f3b340678a0 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3c707640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3b34153270 con 0x7f3b34067c80 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 0x7f3b341f09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 0x7f3b341f09e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52680/0 (socket says 172.21.15.132:52680) 2024-04-25T12:50:06.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 -- 172.21.15.132:0/3662759645 learned_addr learned my addr 172.21.15.132:0/3662759645 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3a4a3640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b340678a0 0x7f3b34144920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b39ca2640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b34067c80 0x7f3b3415a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 -- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b34067c80 msgr2=0x7f3b3415a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b34067c80 0x7f3b3415a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 -- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b340678a0 msgr2=0x7f3b34144920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b340678a0 0x7f3b34144920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b3aca4640 1 -- 172.21.15.132:0/3662759645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b340ca1c0 con 0x7f3b3415cff0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.782+0000 7f3b39ca2640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b34067c80 0x7f3b3415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.783+0000 7f3b3aca4640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 0x7f3b341f09e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00ca70 tx=0x7f3b2c00cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.783+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c017070 con 0x7f3b3415cff0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.783+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b2c00abd0 con 0x7f3b3415cff0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.783+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b340ca5a0 con 0x7f3b3415cff0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.783+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c012400 con 0x7f3b3415cff0 2024-04-25T12:50:06.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.783+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b340c88a0 con 0x7f3b3415cff0 2024-04-25T12:50:06.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.784+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b340741e0 con 0x7f3b3415cff0 2024-04-25T12:50:06.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.784+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b2c01a070 con 0x7f3b3415cff0 2024-04-25T12:50:06.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.784+0000 7f3b2affd640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b1806c920 0x7f3b1806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:06.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.785+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f3b2c08b430 con 0x7f3b3415cff0 2024-04-25T12:50:06.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.785+0000 7f3b3a4a3640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b1806c920 0x7f3b1806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:06.785 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.785+0000 7f3b3a4a3640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b1806c920 0x7f3b1806ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b30034000 tx=0x7f3b3002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:06.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.789+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b2c059560 con 0x7f3b3415cff0 2024-04-25T12:50:06.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.964+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b340c8680 con 0x7f3b3415cff0 2024-04-25T12:50:06.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.965+0000 7f3b2affd640 1 -- 172.21.15.132:0/3662759645 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7f3b2c05d860 con 0x7f3b3415cff0 2024-04-25T12:50:06.964 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:06.964 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":17,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:03.303991+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:06.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b1806c920 msgr2=0x7f3b1806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b1806c920 0x7f3b1806ede0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3b30034000 tx=0x7f3b3002e000 comp rx=0 tx=0).stop 2024-04-25T12:50:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 msgr2=0x7f3b341f09e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 0x7f3b341f09e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c00ca70 tx=0x7f3b2c00cf30 comp rx=0 tx=0).stop 2024-04-25T12:50:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 shutdown_connections 2024-04-25T12:50:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b1806c920 0x7f3b1806ede0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b3415cff0 0x7f3b341f09e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b34067c80 0x7f3b3415a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 --2- 172.21.15.132:0/3662759645 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b340678a0 0x7f3b34144920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:06.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 >> 172.21.15.132:0/3662759645 conn(0x7f3b3406b930 msgr2=0x7f3b34158150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:06.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 shutdown_connections 2024-04-25T12:50:06.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:06.967+0000 7f3b3c707640 1 -- 172.21.15.132:0/3662759645 wait complete. 2024-04-25T12:50:06.977 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T12:50:06.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:07.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.080+0000 7f4a356e1640 1 Processor -- start 2024-04-25T12:50:07.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.080+0000 7f4a356e1640 1 -- start start 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a356e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 0x7f4a30073a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a356e1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3013e2a0 con 0x7f4a300c89c0 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a356e1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a3013e540 con 0x7f4a300c8560 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a356e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3013e820 con 0x7f4a3013b8d0 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4a300c89c0 0x7f4a301590a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40294/0 (socket says 172.21.15.132:40294) 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2f7fe640 1 -- 172.21.15.132:0/3945511676 learned_addr learned my addr 172.21.15.132:0/3945511676 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:07.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182370969 0 0) 0x7f4a3013e2a0 con 0x7f4a300c89c0 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a1c003520 con 0x7f4a300c89c0 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2effd640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 0x7f4a30073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968202381 0 0) 0x7f4a3013e540 con 0x7f4a300c8560 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3013e2a0 con 0x7f4a300c8560 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3836014706 0 0) 0x7f4a1c003520 con 0x7f4a300c89c0 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 msgr2=0x7f4a30073a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 0x7f4a30073a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 >> v1:172.21.15.157:6789/0 conn(0x7f4a300c8560 legacy=0x7f4a300c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a3013eb00 con 0x7f4a300c89c0 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f4a280019f0 con 0x7f4a300c89c0 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 >> v1:172.21.15.132:6789/0 conn(0x7f4a300c89c0 legacy=0x7f4a301590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 0x7f4a1c003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a1c004120 0x7f4a1c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1c004d40 0x7f4a1c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4a3013e820 con 0x7f4a1c004d40 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4a1c00bb00 con 0x7f4a1c004120 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.081+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a1c00bd00 con 0x7f4a3013b8d0 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1c004d40 0x7f4a1c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a27fff640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a1c004120 0x7f4a1c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2effd640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 0x7f4a1c003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 -- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 msgr2=0x7f4a1c003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a3013b8d0 0x7f4a1c003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 -- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a1c004120 msgr2=0x7f4a1c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a1c004120 0x7f4a1c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 -- 172.21.15.132:0/3945511676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1c003520 con 0x7f4a1c004d40 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.082+0000 7f4a2f7fe640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1c004d40 0x7f4a1c0051c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800a710 tx=0x7f4a1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f868436e28a8da62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2800a330 con 0x7f4a1c004d40 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a2802f070 con 0x7f4a1c004d40 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a2e7fc640 1 -- 172.21.15.132:0/3945511676 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a2802bb60 con 0x7f4a1c004d40 2024-04-25T12:50:07.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a356e1640 1 -- 172.21.15.132:0/3945511676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1c004d40 msgr2=0x7f4a1c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a356e1640 1 --2- 172.21.15.132:0/3945511676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a1c004d40 0x7f4a1c0051c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4a2800a710 tx=0x7f4a1c005830 comp rx=0 tx=0).stop 2024-04-25T12:50:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a2f7fe640 1 -- 172.21.15.132:0/3945511676 reap_dead start 2024-04-25T12:50:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a356e1640 1 -- 172.21.15.132:0/3945511676 shutdown_connections 2024-04-25T12:50:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a356e1640 1 -- 172.21.15.132:0/3945511676 >> 172.21.15.132:0/3945511676 conn(0x7f4a30067630 msgr2=0x7f4a30067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a356e1640 1 -- 172.21.15.132:0/3945511676 shutdown_connections 2024-04-25T12:50:07.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.083+0000 7f4a356e1640 1 -- 172.21.15.132:0/3945511676 wait complete. 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.084+0000 7f4a356e1640 1 Processor -- start 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.084+0000 7f4a356e1640 1 -- start start 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a356e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a1c004d40 0x7f4a30141a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a356e1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 0x7f4a300cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a356e1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a301368f0 0x7f4a300cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a356e1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300ca270 con 0x7f4a301364d0 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a356e1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f4a300ca0f0 con 0x7f4a301368f0 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a356e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4a3013bcb0 con 0x7f4a1c004d40 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 0x7f4a300cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 0x7f4a300cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52696/0 (socket says 172.21.15.132:52696) 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 -- 172.21.15.132:0/1887655943 learned_addr learned my addr 172.21.15.132:0/1887655943 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a2effd640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a1c004d40 0x7f4a30141a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a2f7fe640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a301368f0 0x7f4a300cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.088 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 -- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a1c004d40 msgr2=0x7f4a30141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a1c004d40 0x7f4a30141a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 -- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a301368f0 msgr2=0x7f4a300cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a301368f0 0x7f4a300cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 -- 172.21.15.132:0/1887655943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a301408b0 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.085+0000 7f4a27fff640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 0x7f4a300cb1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800f8e0 tx=0x7f4a1800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.086+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a180052e0 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.086+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4a18018070 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.086+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a300ca6d0 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.086+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a1800d970 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.086+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a300cac90 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.087+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a300cebe0 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.087+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4a1800db10 con 0x7f4a301364d0 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.087+0000 7f4a277fe640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f4a1006c920 0x7f4a1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.087+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f4a1808b790 con 0x7f4a301364d0 2024-04-25T12:50:07.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.087+0000 7f4a2effd640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f4a1006c920 0x7f4a1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.088+0000 7f4a2effd640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f4a1006c920 0x7f4a1006ede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009b00 tx=0x7f4a20008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:07.090 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.092+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4a1801a310 con 0x7f4a301364d0 2024-04-25T12:50:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.268+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4a300739e0 con 0x7f4a301364d0 2024-04-25T12:50:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.269+0000 7f4a277fe640 1 -- 172.21.15.132:0/1887655943 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f4a18059fa0 con 0x7f4a301364d0 2024-04-25T12:50:07.267 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f4a1006c920 msgr2=0x7f4a1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f4a1006c920 0x7f4a1006ede0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4a20009b00 tx=0x7f4a20008040 comp rx=0 tx=0).stop 2024-04-25T12:50:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 msgr2=0x7f4a300cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 0x7f4a300cb1b0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f4a1800f8e0 tx=0x7f4a1800fda0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 shutdown_connections 2024-04-25T12:50:07.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f4a1006c920 0x7f4a1006ede0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4a301368f0 0x7f4a300cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a301364d0 0x7f4a300cb1b0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 --2- 172.21.15.132:0/1887655943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f4a1c004d40 0x7f4a30141a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 >> 172.21.15.132:0/1887655943 conn(0x7f4a30067630 msgr2=0x7f4a3013c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 shutdown_connections 2024-04-25T12:50:07.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.271+0000 7f4a356e1640 1 -- 172.21.15.132:0/1887655943 wait complete. 2024-04-25T12:50:07.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:07.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.378+0000 7fe118ca0640 1 Processor -- start 2024-04-25T12:50:07.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.378+0000 7fe118ca0640 1 -- start start 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe118ca0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1141443e0 0x7fe11415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe118ca0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe114071de0 con 0x7fe114068110 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe118ca0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1140720a0 con 0x7fe114067d10 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe118ca0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe1140685a0 con 0x7fe1141443e0 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe11259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1141443e0 0x7fe11415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe112d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe114068110 0x7fe11415c980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40296/0 (socket says 172.21.15.132:40296) 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe112d9d640 1 -- 172.21.15.132:0/916201448 learned_addr learned my addr 172.21.15.132:0/916201448 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.379+0000 7fe11259c640 1 -- 172.21.15.132:0/916201448 >> v1:172.21.15.157:6789/0 conn(0x7fe114067d10 legacy=0x7fe1140cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11259c640 1 -- 172.21.15.132:0/916201448 >> v1:172.21.15.132:6789/0 conn(0x7fe114068110 legacy=0x7fe11415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11259c640 1 -- 172.21.15.132:0/916201448 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe114072380 con 0x7fe1141443e0 2024-04-25T12:50:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11159a640 1 -- 172.21.15.132:0/916201448 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046686304 0 0) 0x7fe114071de0 con 0x7fe114068110 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11259c640 1 --2- 172.21.15.132:0/916201448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11415f2b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1040097a0 tx=0x7fe10402a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d1c72233b4ede server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11159a640 1 -- 172.21.15.132:0/916201448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104037070 con 0x7fe1141443e0 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11159a640 1 -- 172.21.15.132:0/916201448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe104032440 con 0x7fe1141443e0 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.380+0000 7fe11159a640 1 -- 172.21.15.132:0/916201448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104032810 con 0x7fe1141443e0 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 -- 172.21.15.132:0/916201448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 msgr2=0x7fe11415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 --2- 172.21.15.132:0/916201448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11415f2b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe1040097a0 tx=0x7fe10402a230 comp rx=0 tx=0).stop 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 -- 172.21.15.132:0/916201448 shutdown_connections 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 --2- 172.21.15.132:0/916201448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11415f2b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 -- 172.21.15.132:0/916201448 >> 172.21.15.132:0/916201448 conn(0x7fe114075d50 msgr2=0x7fe11406f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 -- 172.21.15.132:0/916201448 shutdown_connections 2024-04-25T12:50:07.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.381+0000 7fe118ca0640 1 -- 172.21.15.132:0/916201448 wait complete. 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.382+0000 7fe118ca0640 1 Processor -- start 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.382+0000 7fe118ca0640 1 -- start start 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe118ca0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe114067d10 0x7fe1141e4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe118ca0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe114068110 0x7fe11415e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe118ca0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11413ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe118ca0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe114072940 con 0x7fe1141443e0 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe118ca0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe114072cb0 con 0x7fe114067d10 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe118ca0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe1141447c0 con 0x7fe114068110 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11413ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11413ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52714/0 (socket says 172.21.15.132:52714) 2024-04-25T12:50:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 -- 172.21.15.132:0/359458252 learned_addr learned my addr 172.21.15.132:0/359458252 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe11259c640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe114067d10 0x7fe1141e4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 -- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe114068110 msgr2=0x7fe11415e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe114068110 0x7fe11415e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 -- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe114067d10 msgr2=0x7fe1141e4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe114067d10 0x7fe1141e4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 -- 172.21.15.132:0/359458252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11415df70 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe11259c640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe114067d10 0x7fe1141e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.383+0000 7fe112d9d640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11413ee10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c7d0 tx=0x7fe10c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.384+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c018070 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.384+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10c00a640 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.384+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00aa30 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.384+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1141e5490 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.384+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe114159520 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.385+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe114068c20 con 0x7fe1141443e0 2024-04-25T12:50:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.385+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe10c01b070 con 0x7fe1141443e0 2024-04-25T12:50:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.385+0000 7fe102ffd640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe0f406c8f0 0x7fe0f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.386+0000 7fe11259c640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe0f406c8f0 0x7fe0f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.386+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe10c08ae30 con 0x7fe1141443e0 2024-04-25T12:50:07.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.386+0000 7fe11259c640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe0f406c8f0 0x7fe0f406edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe104034000 tx=0x7fe10402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:07.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.390+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe11415df70 con 0x7fe1141443e0 2024-04-25T12:50:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.601+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1140c4890 con 0x7fe1141443e0 2024-04-25T12:50:07.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.601+0000 7fe102ffd640 1 -- 172.21.15.132:0/359458252 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7fe10c0595b0 con 0x7fe1141443e0 2024-04-25T12:50:07.600 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:07.600 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-25T12:50:07.600 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 2 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe0f406c8f0 msgr2=0x7fe0f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe0f406c8f0 0x7fe0f406edb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe104034000 tx=0x7fe10402e000 comp rx=0 tx=0).stop 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 msgr2=0x7fe11413ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11413ee10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00c7d0 tx=0x7fe10c00cc90 comp rx=0 tx=0).stop 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 shutdown_connections 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe0f406c8f0 0x7fe0f406edb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1141443e0 0x7fe11413ee10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe114068110 0x7fe11415e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.603+0000 7fe118ca0640 1 --2- 172.21.15.132:0/359458252 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe114067d10 0x7fe1141e4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.604+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 >> 172.21.15.132:0/359458252 conn(0x7fe114075d50 msgr2=0x7fe114140f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.604+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 shutdown_connections 2024-04-25T12:50:07.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:07.604+0000 7fe118ca0640 1 -- 172.21.15.132:0/359458252 wait complete. 2024-04-25T12:50:09.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:09.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.725+0000 7f69d34ef640 1 Processor -- start 2024-04-25T12:50:09.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.725+0000 7f69d34ef640 1 -- start start 2024-04-25T12:50:09.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d34ef640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc152380 0x7f69cc157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:09.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d34ef640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69cc15b500 con 0x7f69cc151fa0 2024-04-25T12:50:09.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d34ef640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69cc0c52f0 con 0x7f69cc0c4cc0 2024-04-25T12:50:09.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d34ef640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc15bae0 con 0x7f69cc152380 2024-04-25T12:50:09.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d128b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f69cc151fa0 0x7f69cc0c8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40300/0 (socket says 172.21.15.132:40300) 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d128b640 1 -- 172.21.15.132:0/2722467843 learned_addr learned my addr 172.21.15.132:0/2722467843 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d0a8a640 1 --2- 172.21.15.132:0/2722467843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc152380 0x7f69cc157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689013113 0 0) 0x7f69cc15b500 con 0x7f69cc151fa0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69b8003520 con 0x7f69cc151fa0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1140672175 0 0) 0x7f69cc0c52f0 con 0x7f69cc0c4cc0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69cc15b500 con 0x7f69cc0c4cc0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006587418 0 0) 0x7f69b8003520 con 0x7f69cc151fa0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d0a8a640 1 -- 172.21.15.132:0/2722467843 >> v1:172.21.15.157:6789/0 conn(0x7f69cc0c4cc0 legacy=0x7f69cc0c9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d0a8a640 1 -- 172.21.15.132:0/2722467843 >> v1:172.21.15.132:6789/0 conn(0x7f69cc151fa0 legacy=0x7f69cc0c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.726+0000 7f69d0a8a640 1 -- 172.21.15.132:0/2722467843 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc0c55d0 con 0x7f69cc152380 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.727+0000 7f69d0a8a640 1 --2- 172.21.15.132:0/2722467843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc152380 0x7f69cc157e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097d0 tx=0x7f69bc02a1a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed674a96fb0a9a4d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.727+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69bc037070 con 0x7f69cc152380 2024-04-25T12:50:09.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.727+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69bc02ac30 con 0x7f69cc152380 2024-04-25T12:50:09.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.727+0000 7f69c3fff640 1 -- 172.21.15.132:0/2722467843 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c8001670 con 0x7f69cc152380 2024-04-25T12:50:09.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 -- 172.21.15.132:0/2722467843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc152380 msgr2=0x7f69cc157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2722467843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc152380 0x7f69cc157e70 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f69bc0097d0 tx=0x7f69bc02a1a0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 -- 172.21.15.132:0/2722467843 shutdown_connections 2024-04-25T12:50:09.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2722467843 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc152380 0x7f69cc157e70 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 -- 172.21.15.132:0/2722467843 >> 172.21.15.132:0/2722467843 conn(0x7f69cc067630 msgr2=0x7f69cc067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 -- 172.21.15.132:0/2722467843 shutdown_connections 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.728+0000 7f69d34ef640 1 -- 172.21.15.132:0/2722467843 wait complete. 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.729+0000 7f69d34ef640 1 Processor -- start 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.729+0000 7f69d34ef640 1 -- start start 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d34ef640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69cc0c4cc0 0x7f69cc06e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d34ef640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc151fa0 0x7f69cc141400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d34ef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 0x7f69cc141940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d34ef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0c3bc0 con 0x7f69cc152380 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d34ef640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f69cc0c58b0 con 0x7f69cc0c4cc0 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d34ef640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f69cc0c9860 con 0x7f69cc151fa0 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 0x7f69cc141940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 0x7f69cc141940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52728/0 (socket says 172.21.15.132:52728) 2024-04-25T12:50:09.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 -- 172.21.15.132:0/2880961639 learned_addr learned my addr 172.21.15.132:0/2880961639 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d128b640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69cc0c4cc0 0x7f69cc06e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d0a8a640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc151fa0 0x7f69cc141400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 -- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc151fa0 msgr2=0x7f69cc141400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc151fa0 0x7f69cc141400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 -- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69cc0c4cc0 msgr2=0x7f69cc06e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69cc0c4cc0 0x7f69cc06e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 -- 172.21.15.132:0/2880961639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69cc14fe80 con 0x7f69cc152380 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d128b640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69cc0c4cc0 0x7f69cc06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.730+0000 7f69d1a8c640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 0x7f69cc141940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c7c0 tx=0x7f69c400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.731+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c4003b70 con 0x7f69cc152380 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.731+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69c4003d10 con 0x7f69cc152380 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.731+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69cc15ad80 con 0x7f69cc152380 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.731+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69c400aa50 con 0x7f69cc152380 2024-04-25T12:50:09.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.731+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69cc1f47f0 con 0x7f69cc152380 2024-04-25T12:50:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.732+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69cc068c20 con 0x7f69cc152380 2024-04-25T12:50:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.732+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f69c400abf0 con 0x7f69cc152380 2024-04-25T12:50:09.732 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.733+0000 7f69c1ffb640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f69b006c8f0 0x7f69b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.733+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f69c408b7a0 con 0x7f69cc152380 2024-04-25T12:50:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.733+0000 7f69d128b640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f69b006c8f0 0x7f69b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:09.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.733+0000 7f69d128b640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f69b006c8f0 0x7f69b006edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69c80011e0 tx=0x7f69c8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:09.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.737+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f69c4059f20 con 0x7f69cc152380 2024-04-25T12:50:09.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.947+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f69cc072c40 con 0x7f69cc152380 2024-04-25T12:50:09.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.947+0000 7f69c1ffb640 1 -- 172.21.15.132:0/2880961639 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5527 (secure 0 0 0) 0x7f69c4059820 con 0x7f69cc152380 2024-04-25T12:50:09.946 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:09.946 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4296,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-25T12:50:09.946 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 3 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f69b006c8f0 msgr2=0x7f69b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f69b006c8f0 0x7f69b006edb0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f69c80011e0 tx=0x7f69c8009040 comp rx=0 tx=0).stop 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 msgr2=0x7f69cc141940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 0x7f69cc141940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f69c400c7c0 tx=0x7f69c400cc80 comp rx=0 tx=0).stop 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 shutdown_connections 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f69b006c8f0 0x7f69b006edb0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69cc152380 0x7f69cc141940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f69cc151fa0 0x7f69cc141400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 --2- 172.21.15.132:0/2880961639 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f69cc0c4cc0 0x7f69cc06e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 >> 172.21.15.132:0/2880961639 conn(0x7f69cc067630 msgr2=0x7f69cc072110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 shutdown_connections 2024-04-25T12:50:09.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:09.949+0000 7f69d34ef640 1 -- 172.21.15.132:0/2880961639 wait complete. 2024-04-25T12:50:09.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:10.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:50:10.041 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:50:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.059+0000 7fddff289640 1 Processor -- start 2024-04-25T12:50:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.059+0000 7fddff289640 1 -- start start 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.059+0000 7fddff289640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf81557e0 0x7fddf80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddff289640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fddf80cc730 0x7fddf80cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddff289640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddf806c9c0 0x7fddf806ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddff289640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fddf80cb5a0 con 0x7fddf806c9c0 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddff289640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fddf815ed80 con 0x7fddf80cc730 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddff289640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fddf815f060 con 0x7fddf81557e0 2024-04-25T12:50:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddf806c9c0 0x7fddf806ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fddf806c9c0 0x7fddf806ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52732/0 (socket says 172.21.15.132:52732) 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 -- 172.21.15.132:0/2451094167 learned_addr learned my addr 172.21.15.132:0/2451094167 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfc824640 1 --2- 172.21.15.132:0/2451094167 >> v2:172.21.15.157:3300/0 conn(0x7fddf80cc730 0x7fddf80cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd025640 1 --2- 172.21.15.132:0/2451094167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf81557e0 0x7fddf80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 -- 172.21.15.132:0/2451094167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf81557e0 msgr2=0x7fddf80cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 --2- 172.21.15.132:0/2451094167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf81557e0 0x7fddf80cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 -- 172.21.15.132:0/2451094167 >> v2:172.21.15.157:3300/0 conn(0x7fddf80cc730 msgr2=0x7fddf80cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 --2- 172.21.15.132:0/2451094167 >> v2:172.21.15.157:3300/0 conn(0x7fddf80cc730 0x7fddf80cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfd826640 1 -- 172.21.15.132:0/2451094167 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf815f340 con 0x7fddf806c9c0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.060+0000 7fddfc824640 1 --2- 172.21.15.132:0/2451094167 >> v2:172.21.15.157:3300/0 conn(0x7fddf80cc730 0x7fddf80cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.061+0000 7fddfd826640 1 --2- 172.21.15.132:0/2451094167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf806c9c0 0x7fddf806ce20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddf806d8f0 tx=0x7fdde802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=266537dae4d79f57 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.061+0000 7fddf7fff640 1 -- 172.21.15.132:0/2451094167 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8036070 con 0x7fddf806c9c0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.061+0000 7fddf7fff640 1 -- 172.21.15.132:0/2451094167 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde8031600 con 0x7fddf806c9c0 2024-04-25T12:50:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.061+0000 7fddf7fff640 1 -- 172.21.15.132:0/2451094167 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde80319d0 con 0x7fddf806c9c0 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 -- 172.21.15.132:0/2451094167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf806c9c0 msgr2=0x7fddf806ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 --2- 172.21.15.132:0/2451094167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf806c9c0 0x7fddf806ce20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fddf806d8f0 tx=0x7fdde802a6a0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 -- 172.21.15.132:0/2451094167 shutdown_connections 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 --2- 172.21.15.132:0/2451094167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf806c9c0 0x7fddf806ce20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 --2- 172.21.15.132:0/2451094167 >> v2:172.21.15.157:3300/0 conn(0x7fddf80cc730 0x7fddf80cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 --2- 172.21.15.132:0/2451094167 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf81557e0 0x7fddf80cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 -- 172.21.15.132:0/2451094167 >> 172.21.15.132:0/2451094167 conn(0x7fddf80d0e10 msgr2=0x7fddf80d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 -- 172.21.15.132:0/2451094167 shutdown_connections 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.062+0000 7fddff289640 1 -- 172.21.15.132:0/2451094167 wait complete. 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.063+0000 7fddff289640 1 Processor -- start 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.063+0000 7fddff289640 1 -- start start 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddff289640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddf806c9c0 0x7fddf80cfb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddff289640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf80cc730 0x7fddf815aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddff289640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 0x7fddf815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddff289640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fddf80cd240 con 0x7fddf81557e0 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddff289640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fddf80cd0c0 con 0x7fddf806c9c0 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddff289640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fddf815e920 con 0x7fddf80cc730 2024-04-25T12:50:10.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 0x7fddf815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 0x7fddf815c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52738/0 (socket says 172.21.15.132:52738) 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 -- 172.21.15.132:0/3215135911 learned_addr learned my addr 172.21.15.132:0/3215135911 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd025640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddf806c9c0 0x7fddf80cfb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfc824640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf80cc730 0x7fddf815aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 -- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf80cc730 msgr2=0x7fddf815aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf80cc730 0x7fddf815aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 -- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddf806c9c0 msgr2=0x7fddf80cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddf806c9c0 0x7fddf80cfb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 -- 172.21.15.132:0/3215135911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddf80cf580 con 0x7fddf81557e0 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd025640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddf806c9c0 0x7fddf80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddfd826640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 0x7fddf815c510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdde8034040 tx=0x7fdde8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.064+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8036050 con 0x7fddf81557e0 2024-04-25T12:50:10.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.065+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdde8042070 con 0x7fddf81557e0 2024-04-25T12:50:10.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.065+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddf80cf860 con 0x7fddf81557e0 2024-04-25T12:50:10.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.065+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdde8009510 con 0x7fddf81557e0 2024-04-25T12:50:10.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.065+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddf81f1270 con 0x7fddf81557e0 2024-04-25T12:50:10.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.066+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf8069330 con 0x7fddf81557e0 2024-04-25T12:50:10.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.066+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdde8007bd0 con 0x7fddf81557e0 2024-04-25T12:50:10.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.066+0000 7fddf5ffb640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdde406c8f0 0x7fdde406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.066+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fdde80ac350 con 0x7fddf81557e0 2024-04-25T12:50:10.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.067+0000 7fddfd025640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdde406c8f0 0x7fdde406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.067+0000 7fddfd025640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdde406c8f0 0x7fdde406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e90 tx=0x7fddf0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.071+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fddf8069330 con 0x7fddf81557e0 2024-04-25T12:50:10.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.246+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fddf8153610 con 0x7fddf81557e0 2024-04-25T12:50:10.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.247+0000 7fddf5ffb640 1 -- 172.21.15.132:0/3215135911 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12920 (secure 0 0 0) 0x7fdde807a510 con 0x7fddf81557e0 2024-04-25T12:50:10.246 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:10.246 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":17,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:03.303991+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.249+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdde406c8f0 msgr2=0x7fdde406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.249+0000 7fddff289640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdde406c8f0 0x7fdde406edb0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fddf0009e90 tx=0x7fddf0009190 comp rx=0 tx=0).stop 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.249+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 msgr2=0x7fddf815c510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.249+0000 7fddff289640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 0x7fddf815c510 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdde8034040 tx=0x7fdde8004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 shutdown_connections 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdde406c8f0 0x7fdde406edb0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddf81557e0 0x7fddf815c510 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fddf80cc730 0x7fddf815aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 --2- 172.21.15.132:0/3215135911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fddf806c9c0 0x7fddf80cfb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 >> 172.21.15.132:0/3215135911 conn(0x7fddf80d0e10 msgr2=0x7fddf80c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 shutdown_connections 2024-04-25T12:50:10.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.250+0000 7fddff289640 1 -- 172.21.15.132:0/3215135911 wait complete. 2024-04-25T12:50:10.259 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T12:50:10.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:10.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.361+0000 7f0ba8307640 1 Processor -- start 2024-04-25T12:50:10.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.361+0000 7f0ba8307640 1 -- start start 2024-04-25T12:50:10.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.362+0000 7f0ba8307640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ba015e920 0x7f0ba015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.363 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.362+0000 7f0ba8307640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba015c050 0x7f0ba0072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.362+0000 7f0ba8307640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ba00cc150 con 0x7f0ba0144550 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.362+0000 7f0ba8307640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0ba00c9cd0 con 0x7f0ba015e920 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.362+0000 7f0ba8307640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba015b330 con 0x7f0ba015c050 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba58a2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ba015e920 0x7f0ba015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba68a4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba015c050 0x7f0ba0072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba60a3640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0ba0144550 0x7f0ba00cba40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:50240/0 (socket says 172.21.15.132:50240) 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba58a2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0ba015e920 0x7f0ba015bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:52356/0 (socket says 172.21.15.132:52356) 2024-04-25T12:50:10.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba60a3640 1 -- 172.21.15.132:0/2405869455 learned_addr learned my addr 172.21.15.132:0/2405869455 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba68a4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba015c050 0x7f0ba0072ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:59204/0 (socket says 172.21.15.132:59204) 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba58a2640 1 -- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba015c050 msgr2=0x7f0ba0072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba58a2640 1 --2- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba015c050 0x7f0ba0072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba58a2640 1 -- 172.21.15.132:0/2405869455 >> v1:172.21.15.157:6789/0 conn(0x7f0ba0144550 legacy=0x7f0ba00cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.363+0000 7f0ba58a2640 1 -- 172.21.15.132:0/2405869455 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba015ee10 con 0x7f0ba015e920 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.364+0000 7f0ba58a2640 1 --2- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015e920 0x7f0ba015bb10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b900097a0 tx=0x7f0b9002a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=262e28a4a825dfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.364+0000 7f0ba50a1640 1 -- 172.21.15.132:0/2405869455 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90037070 con 0x7f0ba015e920 2024-04-25T12:50:10.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.364+0000 7f0ba50a1640 1 -- 172.21.15.132:0/2405869455 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b90032440 con 0x7f0ba015e920 2024-04-25T12:50:10.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.364+0000 7f0ba50a1640 1 -- 172.21.15.132:0/2405869455 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90032810 con 0x7f0ba015e920 2024-04-25T12:50:10.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 -- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015e920 msgr2=0x7f0ba015bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 --2- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015e920 0x7f0ba015bb10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0b900097a0 tx=0x7f0b9002a180 comp rx=0 tx=0).stop 2024-04-25T12:50:10.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 -- 172.21.15.132:0/2405869455 shutdown_connections 2024-04-25T12:50:10.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 --2- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba015c050 0x7f0ba0072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 --2- 172.21.15.132:0/2405869455 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015e920 0x7f0ba015bb10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 -- 172.21.15.132:0/2405869455 >> 172.21.15.132:0/2405869455 conn(0x7f0ba0070a90 msgr2=0x7f0ba0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 -- 172.21.15.132:0/2405869455 shutdown_connections 2024-04-25T12:50:10.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.365+0000 7f0ba8307640 1 -- 172.21.15.132:0/2405869455 wait complete. 2024-04-25T12:50:10.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 Processor -- start 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 -- start start 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba0144550 0x7f0ba01f4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015c050 0x7f0ba013d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 0x7f0ba01f0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba015f6b0 con 0x7f0ba015e920 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba015f3d0 con 0x7f0ba015c050 2024-04-25T12:50:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.366+0000 7f0ba8307640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0ba015b5f0 con 0x7f0ba0144550 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 0x7f0ba01f0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 0x7f0ba01f0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52752/0 (socket says 172.21.15.132:52752) 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 -- 172.21.15.132:0/795393930 learned_addr learned my addr 172.21.15.132:0/795393930 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba58a2640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015c050 0x7f0ba013d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba60a3640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba0144550 0x7f0ba01f4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 -- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba0144550 msgr2=0x7f0ba01f4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.376 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba0144550 0x7f0ba01f4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 -- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015c050 msgr2=0x7f0ba013d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015c050 0x7f0ba013d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 -- 172.21.15.132:0/795393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba00cf350 con 0x7f0ba015e920 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba68a4640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 0x7f0ba01f0df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009e30 tx=0x7f0b9800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98018020 con 0x7f0ba015e920 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b98014480 con 0x7f0ba015e920 2024-04-25T12:50:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98014870 con 0x7f0ba015e920 2024-04-25T12:50:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba00c8bc0 con 0x7f0ba015e920 2024-04-25T12:50:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.367+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba01f4360 con 0x7f0ba015e920 2024-04-25T12:50:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.368+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba0068d00 con 0x7f0ba015e920 2024-04-25T12:50:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.369+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0b98005d10 con 0x7f0ba015e920 2024-04-25T12:50:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.369+0000 7f0b96ffd640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0b8406c8f0 0x7f0b8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.369+0000 7f0ba60a3640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0b8406c8f0 0x7f0b8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.369+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f0b9808c520 con 0x7f0ba015e920 2024-04-25T12:50:10.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.370+0000 7f0ba60a3640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0b8406c8f0 0x7f0b8406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c007fd0 tx=0x7f0b9c007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.374+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0b98022030 con 0x7f0ba015e920 2024-04-25T12:50:10.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.547+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0ba00c9330 con 0x7f0ba015e920 2024-04-25T12:50:10.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.548+0000 7f0b96ffd640 1 -- 172.21.15.132:0/795393930 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7f0b98010040 con 0x7f0ba015e920 2024-04-25T12:50:10.546 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:10.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0b8406c8f0 msgr2=0x7f0b8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0b8406c8f0 0x7f0b8406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c007fd0 tx=0x7f0b9c007e80 comp rx=0 tx=0).stop 2024-04-25T12:50:10.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 msgr2=0x7f0ba01f0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 0x7f0ba01f0df0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009e30 tx=0x7f0b9800c490 comp rx=0 tx=0).stop 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 shutdown_connections 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0b8406c8f0 0x7f0b8406edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ba015e920 0x7f0ba01f0df0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0ba015c050 0x7f0ba013d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 --2- 172.21.15.132:0/795393930 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0ba0144550 0x7f0ba01f4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 >> 172.21.15.132:0/795393930 conn(0x7f0ba0070a90 msgr2=0x7f0ba015ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 shutdown_connections 2024-04-25T12:50:10.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.550+0000 7f0ba8307640 1 -- 172.21.15.132:0/795393930 wait complete. 2024-04-25T12:50:10.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T12:50:10.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.657+0000 7f48a8db4640 1 Processor -- start 2024-04-25T12:50:10.655 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.657+0000 7f48a8db4640 1 -- start start 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a8db4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 0x7f48a415bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a8db4640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f48a4070870 0x7f48a4070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a8db4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48a40cb290 con 0x7f48a40cb740 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a8db4640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f48a40c8dc0 con 0x7f48a4070870 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a8db4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f48a415c270 con 0x7f48a40c89e0 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f489bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48a40cb740 0x7f48a40cbb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40314/0 (socket says 172.21.15.132:40314) 2024-04-25T12:50:10.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f489bfff640 1 -- 172.21.15.132:0/4172674112 learned_addr learned my addr 172.21.15.132:0/4172674112 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2146539176 0 0) 0x7f48a40cb290 con 0x7f48a40cb740 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4890003520 con 0x7f48a40cb740 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a2d9d640 1 --2- 172.21.15.132:0/4172674112 >> v2:172.21.15.157:3300/0 conn(0x7f48a4070870 0x7f48a4070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a259c640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 0x7f48a415bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1368006406 0 0) 0x7f4890003520 con 0x7f48a40cb740 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 msgr2=0x7f48a415bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 0x7f48a415bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 >> v2:172.21.15.157:3300/0 conn(0x7f48a4070870 msgr2=0x7f48a4070ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 --2- 172.21.15.132:0/4172674112 >> v2:172.21.15.157:3300/0 conn(0x7f48a4070870 0x7f48a4070ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a415eaf0 con 0x7f48a40cb740 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f488c001670 con 0x7f48a40cb740 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 >> v1:172.21.15.132:6789/0 conn(0x7f48a40cb740 legacy=0x7f48a40cbb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 0x7f48900039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4890003f30 0x7f4890004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890004d40 0x7f48900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f48a40c8dc0 con 0x7f4890003f30 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f489000b9c0 con 0x7f4890004d40 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.658+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f489000bb70 con 0x7f48a40c89e0 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4890003f30 0x7f4890004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f48a259c640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 0x7f48900039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f48a2d9d640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890004d40 0x7f48900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 -- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 msgr2=0x7f48900039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a40c89e0 0x7f48900039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 -- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890004d40 msgr2=0x7f48900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890004d40 0x7f48900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 -- 172.21.15.132:0/4172674112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4890003520 con 0x7f4890003f30 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f489bfff640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4890003f30 0x7f4890004800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c240 tx=0x7f4890005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ee8ab4dfeebd67f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.659+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c02e070 con 0x7f4890003f30 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f488c005af0 con 0x7f4890003f30 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a1d9b640 1 -- 172.21.15.132:0/4172674112 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c007d30 con 0x7f4890003f30 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a8db4640 1 -- 172.21.15.132:0/4172674112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4890003f30 msgr2=0x7f4890004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a8db4640 1 --2- 172.21.15.132:0/4172674112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4890003f30 0x7f4890004800 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c240 tx=0x7f4890005830 comp rx=0 tx=0).stop 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a2d9d640 1 -- 172.21.15.132:0/4172674112 reap_dead start 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a8db4640 1 -- 172.21.15.132:0/4172674112 shutdown_connections 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a8db4640 1 -- 172.21.15.132:0/4172674112 >> 172.21.15.132:0/4172674112 conn(0x7f48a4072f10 msgr2=0x7f48a4073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a8db4640 1 -- 172.21.15.132:0/4172674112 shutdown_connections 2024-04-25T12:50:10.662 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.660+0000 7f48a8db4640 1 -- 172.21.15.132:0/4172674112 wait complete. 2024-04-25T12:50:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.661+0000 7f48a8db4640 1 Processor -- start 2024-04-25T12:50:10.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.661+0000 7f48a8db4640 1 -- start start 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a8db4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890003f30 0x7f48a41e6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a8db4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 0x7f48a41f11d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a8db4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a41f1710 0x7f48a414cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a8db4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f48a415f0b0 con 0x7f48a40cf440 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a8db4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f48a415e8a0 con 0x7f4890003f30 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a8db4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f48a415f390 con 0x7f48a41f1710 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 0x7f48a41f11d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 0x7f48a41f11d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52768/0 (socket says 172.21.15.132:52768) 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 -- 172.21.15.132:0/3175171254 learned_addr learned my addr 172.21.15.132:0/3175171254 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a259c640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890003f30 0x7f48a41e6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a2d9d640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a41f1710 0x7f48a414cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 -- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a41f1710 msgr2=0x7f48a414cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.666 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a41f1710 0x7f48a414cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 -- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890003f30 msgr2=0x7f48a41e6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890003f30 0x7f48a41e6aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f489bfff640 1 -- 172.21.15.132:0/3175171254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48a4156fd0 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.662+0000 7f48a259c640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890003f30 0x7f48a41e6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f48a2d9d640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a41f1710 0x7f48a414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f489bfff640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 0x7f48a41f11d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c360 tx=0x7f48a40c5ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c042070 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f488c007480 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48a41587b0 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f488c007d30 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.663+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48a41e74f0 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.664+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48a4069330 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.664+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f488c045070 con 0x7f48a40cf440 2024-04-25T12:50:10.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.665+0000 7f489affd640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f488406c8f0 0x7f488406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.665+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f488c0ac140 con 0x7f48a40cf440 2024-04-25T12:50:10.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.665+0000 7f48a259c640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f488406c8f0 0x7f488406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.665+0000 7f48a259c640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f488406c8f0 0x7f488406edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48940099e0 tx=0x7f4894008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.669+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f48a4069330 con 0x7f48a40cf440 2024-04-25T12:50:10.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.848+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f48a40cbda0 con 0x7f48a40cf440 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.848+0000 7f489affd640 1 -- 172.21.15.132:0/3175171254 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f488c005ac0 con 0x7f48a40cf440 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-25T12:50:10.847 INFO:teuthology.orchestra.run.smithi132.stdout:] 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f488406c8f0 msgr2=0x7f488406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f488406c8f0 0x7f488406edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f48940099e0 tx=0x7f4894008040 comp rx=0 tx=0).stop 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 msgr2=0x7f48a41f11d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 0x7f48a41f11d0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c360 tx=0x7f48a40c5ef0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 shutdown_connections 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f488406c8f0 0x7f488406edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f48a41f1710 0x7f48a414cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48a40cf440 0x7f48a41f11d0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 --2- 172.21.15.132:0/3175171254 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f4890003f30 0x7f48a41e6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 >> 172.21.15.132:0/3175171254 conn(0x7f48a4072f10 msgr2=0x7f48a40c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.850+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 shutdown_connections 2024-04-25T12:50:10.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.851+0000 7f48a8db4640 1 -- 172.21.15.132:0/3175171254 wait complete. 2024-04-25T12:50:10.859 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T12:50:10.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T12:50:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.962+0000 7f679daa7640 1 Processor -- start 2024-04-25T12:50:10.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.962+0000 7f679daa7640 1 -- start start 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f679daa7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6798071820 0x7f679815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f679daa7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6798141230 con 0x7f67980c7130 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f679daa7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67980c83f0 con 0x7f679815b740 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f679daa7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f67980c7510 con 0x7f6798071820 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f6796ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6798071820 0x7f679815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f67977fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f67980c7130 0x7f67980c79b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40318/0 (socket says 172.21.15.132:40318) 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f67977fe640 1 -- 172.21.15.132:0/801312268 learned_addr learned my addr 172.21.15.132:0/801312268 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f6796ffd640 1 -- 172.21.15.132:0/801312268 >> v1:172.21.15.157:6789/0 conn(0x7f679815b740 legacy=0x7f67980c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f6796ffd640 1 -- 172.21.15.132:0/801312268 >> v1:172.21.15.132:6789/0 conn(0x7f67980c7130 legacy=0x7f67980c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f6796ffd640 1 -- 172.21.15.132:0/801312268 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6798140470 con 0x7f6798071820 2024-04-25T12:50:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.963+0000 7f67967fc640 1 -- 172.21.15.132:0/801312268 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576851638 0 0) 0x7f6798141230 con 0x7f67980c7130 2024-04-25T12:50:10.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f6796ffd640 1 --2- 172.21.15.132:0/801312268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f679815b200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f678c0097a0 tx=0x7f678c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4334df077b6defb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f67967fc640 1 -- 172.21.15.132:0/801312268 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c037070 con 0x7f6798071820 2024-04-25T12:50:10.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f67967fc640 1 -- 172.21.15.132:0/801312268 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f678c02ae50 con 0x7f6798071820 2024-04-25T12:50:10.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f67967fc640 1 -- 172.21.15.132:0/801312268 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c032660 con 0x7f6798071820 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 -- 172.21.15.132:0/801312268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 msgr2=0x7f679815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 --2- 172.21.15.132:0/801312268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f679815b200 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f678c0097a0 tx=0x7f678c02a140 comp rx=0 tx=0).stop 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 -- 172.21.15.132:0/801312268 shutdown_connections 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 --2- 172.21.15.132:0/801312268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f679815b200 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 -- 172.21.15.132:0/801312268 >> 172.21.15.132:0/801312268 conn(0x7f679806d4c0 msgr2=0x7f679806d8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 -- 172.21.15.132:0/801312268 shutdown_connections 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.964+0000 7f679daa7640 1 -- 172.21.15.132:0/801312268 wait complete. 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 Processor -- start 2024-04-25T12:50:10.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 -- start start 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f67981425b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67980c7130 0x7f6798137170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f679815b740 0x7f6798143800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6798140a30 con 0x7f6798071820 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67980c86d0 con 0x7f67980c7130 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f679daa7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6798140d10 con 0x7f679815b740 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.966+0000 7f67977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f67981425b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f67981425b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52776/0 (socket says 172.21.15.132:52776) 2024-04-25T12:50:10.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 -- 172.21.15.132:0/1375516788 learned_addr learned my addr 172.21.15.132:0/1375516788 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f6796ffd640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67980c7130 0x7f6798137170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f6797fff640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f679815b740 0x7f6798143800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 -- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f679815b740 msgr2=0x7f6798143800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f679815b740 0x7f6798143800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 -- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67980c7130 msgr2=0x7f6798137170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67980c7130 0x7f6798137170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 -- 172.21.15.132:0/1375516788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67981434e0 con 0x7f6798071820 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f6796ffd640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67980c7130 0x7f6798137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f67977fe640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f67981425b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f678800c400 tx=0x7f678800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788017070 con 0x7f6798071820 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6788005ce0 con 0x7f6798071820 2024-04-25T12:50:10.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6798142c40 con 0x7f6798071820 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6788007310 con 0x7f6798071820 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.967+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6798143200 con 0x7f6798071820 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.968+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6798068da0 con 0x7f6798071820 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.968+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f678801a070 con 0x7f6798071820 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.969+0000 7f677ffff640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f678406c920 0x7f678406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.969+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f678808ac80 con 0x7f6798071820 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.969+0000 7f6796ffd640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f678406c920 0x7f678406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:10.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.969+0000 7f6796ffd640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f678406c920 0x7f678406ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f678c034000 tx=0x7f678c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:10.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:10.973+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6788059370 con 0x7f6798071820 2024-04-25T12:50:11.148 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.150+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f6798144770 con 0x7f6798071820 2024-04-25T12:50:11.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.326+0000 7f677ffff640 1 -- 172.21.15.132:0/1375516788 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f6788058c70 con 0x7f6798071820 2024-04-25T12:50:11.324 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2024-04-25T12:50:11.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f678406c920 msgr2=0x7f678406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f678406c920 0x7f678406ede0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f678c034000 tx=0x7f678c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 msgr2=0x7f67981425b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f67981425b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f678800c400 tx=0x7f678800c8c0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 shutdown_connections 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f678406c920 0x7f678406ede0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f679815b740 0x7f6798143800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67980c7130 0x7f6798137170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 --2- 172.21.15.132:0/1375516788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6798071820 0x7f67981425b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 >> 172.21.15.132:0/1375516788 conn(0x7f679806d4c0 msgr2=0x7f6798072ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 shutdown_connections 2024-04-25T12:50:11.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.328+0000 7f679daa7640 1 -- 172.21.15.132:0/1375516788 wait complete. 2024-04-25T12:50:11.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-25T12:50:11.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.446+0000 7feb95c9a640 1 Processor -- start 2024-04-25T12:50:11.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.446+0000 7feb95c9a640 1 -- start start 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb95c9a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb9006c350 0x7feb9006c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb95c9a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015bd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb95c9a640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb900c94c0 0x7feb900c9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb95c9a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7feb9015c280 con 0x7feb9006c350 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb95c9a640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7feb900c9e90 con 0x7feb900c94c0 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb95c9a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb900cb6f0 con 0x7feb9006d070 2024-04-25T12:50:11.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb9006c350 0x7feb9006c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb9006c350 0x7feb9006c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52778/0 (socket says 172.21.15.132:52778) 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 -- 172.21.15.132:0/79916891 learned_addr learned my addr 172.21.15.132:0/79916891 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8effd640 1 --2- 172.21.15.132:0/79916891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015bd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8ffff640 1 --2- 172.21.15.132:0/79916891 >> v2:172.21.15.157:3300/0 conn(0x7feb900c94c0 0x7feb900c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 -- 172.21.15.132:0/79916891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 msgr2=0x7feb9015bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 --2- 172.21.15.132:0/79916891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015bd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 -- 172.21.15.132:0/79916891 >> v2:172.21.15.157:3300/0 conn(0x7feb900c94c0 msgr2=0x7feb900c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 --2- 172.21.15.132:0/79916891 >> v2:172.21.15.157:3300/0 conn(0x7feb900c94c0 0x7feb900c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.447+0000 7feb8f7fe640 1 -- 172.21.15.132:0/79916891 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb900cb9d0 con 0x7feb9006c350 2024-04-25T12:50:11.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.448+0000 7feb8f7fe640 1 --2- 172.21.15.132:0/79916891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb9006c730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb900cd390 tx=0x7feb8002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce9aace4df328d9c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.448+0000 7feb8e7fc640 1 -- 172.21.15.132:0/79916891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80037070 con 0x7feb9006c350 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.448+0000 7feb8e7fc640 1 -- 172.21.15.132:0/79916891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb80032440 con 0x7feb9006c350 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.448+0000 7feb8e7fc640 1 -- 172.21.15.132:0/79916891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80032810 con 0x7feb9006c350 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 -- 172.21.15.132:0/79916891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 msgr2=0x7feb9006c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 --2- 172.21.15.132:0/79916891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb9006c730 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feb900cd390 tx=0x7feb8002a270 comp rx=0 tx=0).stop 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 -- 172.21.15.132:0/79916891 shutdown_connections 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 --2- 172.21.15.132:0/79916891 >> v2:172.21.15.157:3300/0 conn(0x7feb900c94c0 0x7feb900c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 --2- 172.21.15.132:0/79916891 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015bd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 --2- 172.21.15.132:0/79916891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb9006c730 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 -- 172.21.15.132:0/79916891 >> 172.21.15.132:0/79916891 conn(0x7feb900d0b80 msgr2=0x7feb900d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:11.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 -- 172.21.15.132:0/79916891 shutdown_connections 2024-04-25T12:50:11.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.449+0000 7feb95c9a640 1 -- 172.21.15.132:0/79916891 wait complete. 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.450+0000 7feb95c9a640 1 Processor -- start 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.450+0000 7feb95c9a640 1 -- start start 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb90159190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015aba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900c94c0 0x7feb901f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feb900cc270 con 0x7feb9006c350 2024-04-25T12:50:11.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb900cbf90 con 0x7feb900c94c0 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb900cb320 con 0x7feb9006d070 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb90159190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb90159190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52788/0 (socket says 172.21.15.132:52788) 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 -- 172.21.15.132:0/2899126901 learned_addr learned my addr 172.21.15.132:0/2899126901 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8ffff640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900c94c0 0x7feb901f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 -- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 msgr2=0x7feb9015aba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015aba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 -- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900c94c0 msgr2=0x7feb901f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900c94c0 0x7feb901f3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 -- 172.21.15.132:0/2899126901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb901e6f90 con 0x7feb9006c350 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb8f7fe640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb90159190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb80000c00 tx=0x7feb800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80041020 con 0x7feb9006c350 2024-04-25T12:50:11.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb800306c0 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb901e7270 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb80037040 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.451+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb9015a680 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.452+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb900ca9f0 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.453+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb80044020 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.453+0000 7feb77fff640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb7c06c920 0x7feb7c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.453+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7feb800ac120 con 0x7feb9006c350 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.453+0000 7feb8effd640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb7c06c920 0x7feb7c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:11.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.453+0000 7feb8effd640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb7c06c920 0x7feb7c06ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb900c9cd0 tx=0x7feb84008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:11.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.458+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb900ca9f0 con 0x7feb9006c350 2024-04-25T12:50:11.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:11.635+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7feb901558b0 con 0x7feb9006c350 2024-04-25T12:50:12.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.328+0000 7feb77fff640 1 -- 172.21.15.132:0/2899126901 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7feb901558b0 con 0x7feb9006c350 2024-04-25T12:50:12.327 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb7c06c920 msgr2=0x7feb7c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb7c06c920 0x7feb7c06ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feb900c9cd0 tx=0x7feb84008040 comp rx=0 tx=0).stop 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 msgr2=0x7feb90159190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb90159190 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7feb80000c00 tx=0x7feb800046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 shutdown_connections 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb7c06c920 0x7feb7c06ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb900c94c0 0x7feb901f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb9006d070 0x7feb9015aba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 --2- 172.21.15.132:0/2899126901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb9006c350 0x7feb90159190 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.331+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 >> 172.21.15.132:0/2899126901 conn(0x7feb900d0b80 msgr2=0x7feb90152310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:12.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.332+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 shutdown_connections 2024-04-25T12:50:12.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.332+0000 7feb95c9a640 1 -- 172.21.15.132:0/2899126901 wait complete. 2024-04-25T12:50:12.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T12:50:12.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.461+0000 7fe0b7e6b640 1 Processor -- start 2024-04-25T12:50:12.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.461+0000 7fe0b7e6b640 1 -- start start 2024-04-25T12:50:12.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b7e6b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0b0072ea0 0x7fe0b00732d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:12.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b7e6b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b01538d0 con 0x7fe0b01534f0 2024-04-25T12:50:12.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b7e6b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0b0159130 con 0x7fe0b00cbcb0 2024-04-25T12:50:12.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b7e6b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe0b00c6670 con 0x7fe0b0072ea0 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b6408640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0b0072ea0 0x7fe0b00732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b6408640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0b0072ea0 0x7fe0b00732d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55792/0 (socket says 172.21.15.132:55792) 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b6408640 1 -- 172.21.15.132:0/414551490 learned_addr learned my addr 172.21.15.132:0/414551490 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b5c07640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe0b01534f0 0x7fe0b015c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34554/0 (socket says 172.21.15.132:34554) 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b6408640 1 -- 172.21.15.132:0/414551490 >> v1:172.21.15.157:6789/0 conn(0x7fe0b00cbcb0 legacy=0x7fe0b00c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b6408640 1 -- 172.21.15.132:0/414551490 >> v1:172.21.15.132:6789/0 conn(0x7fe0b01534f0 legacy=0x7fe0b015c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:12.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.462+0000 7fe0b6408640 1 -- 172.21.15.132:0/414551490 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b00c6950 con 0x7fe0b0072ea0 2024-04-25T12:50:12.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b6408640 1 --2- 172.21.15.132:0/414551490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00732d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009e50 tx=0x7fe0a802a6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c02cd5307e13160 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b4c05640 1 -- 172.21.15.132:0/414551490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a8036070 con 0x7fe0b0072ea0 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b4c05640 1 -- 172.21.15.132:0/414551490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0a8031600 con 0x7fe0b0072ea0 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b4c05640 1 -- 172.21.15.132:0/414551490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0a80319d0 con 0x7fe0b0072ea0 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/414551490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 msgr2=0x7fe0b00732d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/414551490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00732d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe0a8009e50 tx=0x7fe0a802a6d0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/414551490 shutdown_connections 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/414551490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00732d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/414551490 >> 172.21.15.132:0/414551490 conn(0x7fe0b0070a90 msgr2=0x7fe0b0070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/414551490 shutdown_connections 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.463+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/414551490 wait complete. 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 Processor -- start 2024-04-25T12:50:12.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 -- start start 2024-04-25T12:50:12.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:12.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0b00cbcb0 0x7fe0b01514f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:12.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b01534f0 0x7fe0b01f1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:12.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b00c8cb0 con 0x7fe0b0072ea0 2024-04-25T12:50:12.466 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe0b01596d0 con 0x7fe0b01534f0 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b7e6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe0b0159ed0 con 0x7fe0b00cbcb0 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b5c07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b5c07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00ceb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55800/0 (socket says 172.21.15.132:55800) 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.465+0000 7fe0b5c07640 1 -- 172.21.15.132:0/3557672713 learned_addr learned my addr 172.21.15.132:0/3557672713 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b6408640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b01534f0 0x7fe0b01f1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5406640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0b00cbcb0 0x7fe0b01514f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5c07640 1 -- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0b00cbcb0 msgr2=0x7fe0b01514f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5c07640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0b00cbcb0 0x7fe0b01514f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5c07640 1 -- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b01534f0 msgr2=0x7fe0b01f1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:12.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5c07640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b01534f0 0x7fe0b01f1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5c07640 1 -- 172.21.15.132:0/3557672713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0b0146980 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b6408640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b01534f0 0x7fe0b01f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b5c07640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00ceb50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00c3f0 tx=0x7fe0ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac0074e0 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe0ac007680 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0b0151e10 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0ac004a00 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.466+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0b01f0a60 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.467+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0b0068d00 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.467+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe0ac01a020 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.468+0000 7fe0a67fc640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09406c920 0x7fe09406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.468+0000 7fe0b5406640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09406c920 0x7fe09406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.468+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7fe0ac08b1f0 con 0x7fe0b0072ea0 2024-04-25T12:50:12.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.468+0000 7fe0b5406640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09406c920 0x7fe09406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0006fd0 tx=0x7fe0a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.472+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe0b0146980 con 0x7fe0b0072ea0 2024-04-25T12:50:12.683 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:12.685+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fe0b00ca4b0 con 0x7fe0b0072ea0 2024-04-25T12:50:13.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.350+0000 7fe0a67fc640 1 -- 172.21.15.132:0/3557672713 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fe0ac059710 con 0x7fe0b0072ea0 2024-04-25T12:50:13.349 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 2 and data pool 3 2024-04-25T12:50:13.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.360+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09406c920 msgr2=0x7fe09406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:13.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.360+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09406c920 0x7fe09406ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe0a0006fd0 tx=0x7fe0a0008040 comp rx=0 tx=0).stop 2024-04-25T12:50:13.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.360+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 msgr2=0x7fe0b00ceb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:13.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.360+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00ceb50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe0ac00c3f0 tx=0x7fe0ac00c8b0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 shutdown_connections 2024-04-25T12:50:13.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09406c920 0x7fe09406ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe0b01534f0 0x7fe0b01f1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe0b00cbcb0 0x7fe0b01514f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 --2- 172.21.15.132:0/3557672713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b0072ea0 0x7fe0b00ceb50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 >> 172.21.15.132:0/3557672713 conn(0x7fe0b0070a90 msgr2=0x7fe0b00c80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:13.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.361+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 shutdown_connections 2024-04-25T12:50:13.361 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.362+0000 7fe0b7e6b640 1 -- 172.21.15.132:0/3557672713 wait complete. 2024-04-25T12:50:13.375 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-25T12:50:13.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-25T12:50:13.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.481+0000 7f084bc2a640 1 Processor -- start 2024-04-25T12:50:13.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.481+0000 7f084bc2a640 1 -- start start 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084bc2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08440c8130 0x7f084415b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084bc2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c93a0 0x7f08440c97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084bc2a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f084415bb70 con 0x7f08440c7d50 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084bc2a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f08440c9d10 con 0x7f08440c8130 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084bc2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f084415be50 con 0x7f08440c93a0 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08440c8130 0x7f084415b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f08440c8130 0x7f084415b2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55804/0 (socket says 172.21.15.132:55804) 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 -- 172.21.15.132:0/1409372915 learned_addr learned my addr 172.21.15.132:0/1409372915 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084a1c7640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c93a0 0x7f08440c97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 -- 172.21.15.132:0/1409372915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c93a0 msgr2=0x7f08440c97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c93a0 0x7f08440c97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 -- 172.21.15.132:0/1409372915 >> v1:172.21.15.157:6789/0 conn(0x7f08440c7d50 legacy=0x7f08440cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f08491c5640 1 -- 172.21.15.132:0/1409372915 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f084415c130 con 0x7f08440c8130 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.482+0000 7f084a1c7640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c93a0 0x7f08440c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f08491c5640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c8130 0x7f084415b2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0834009870 tx=0x7f083402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11682f46584f1163 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f08489c4640 1 -- 172.21.15.132:0/1409372915 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834037070 con 0x7f08440c8130 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f08489c4640 1 -- 172.21.15.132:0/1409372915 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083402ae50 con 0x7f08440c8130 2024-04-25T12:50:13.482 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f08489c4640 1 -- 172.21.15.132:0/1409372915 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0834032860 con 0x7f08440c8130 2024-04-25T12:50:13.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f084bc2a640 1 -- 172.21.15.132:0/1409372915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c8130 msgr2=0x7f084415b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:13.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f084bc2a640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c8130 0x7f084415b2c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0834009870 tx=0x7f083402a300 comp rx=0 tx=0).stop 2024-04-25T12:50:13.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f084bc2a640 1 -- 172.21.15.132:0/1409372915 shutdown_connections 2024-04-25T12:50:13.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f084bc2a640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c93a0 0x7f08440c97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f084bc2a640 1 --2- 172.21.15.132:0/1409372915 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c8130 0x7f084415b2c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.483+0000 7f084bc2a640 1 -- 172.21.15.132:0/1409372915 >> 172.21.15.132:0/1409372915 conn(0x7f0844067810 msgr2=0x7f0844067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.484+0000 7f084bc2a640 1 -- 172.21.15.132:0/1409372915 shutdown_connections 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.484+0000 7f084bc2a640 1 -- 172.21.15.132:0/1409372915 wait complete. 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 Processor -- start 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 -- start start 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c7d50 0x7f08441f1150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08440c8130 0x7f084415b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 0x7f0844158260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c8e80 con 0x7f08440c93a0 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f08440c8ba0 con 0x7f08440c8130 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084bc2a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f08440c8580 con 0x7f08440c7d50 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084a1c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 0x7f0844158260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:13.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084a1c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 0x7f0844158260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55818/0 (socket says 172.21.15.132:55818) 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.485+0000 7f084a1c7640 1 -- 172.21.15.132:0/2571500754 learned_addr learned my addr 172.21.15.132:0/2571500754 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f08491c5640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08440c8130 0x7f084415b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f08499c6640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c7d50 0x7f08441f1150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084a1c7640 1 -- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c7d50 msgr2=0x7f08441f1150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084a1c7640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c7d50 0x7f08441f1150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084a1c7640 1 -- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08440c8130 msgr2=0x7f084415b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084a1c7640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08440c8130 0x7f084415b2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084a1c7640 1 -- 172.21.15.132:0/2571500754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08441f1740 con 0x7f08440c93a0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084a1c7640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 0x7f0844158260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f083c007ea0 tx=0x7f083c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c01a070 con 0x7f08440c93a0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f083c003bb0 con 0x7f08440c93a0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f083c00de70 con 0x7f08440c93a0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08441f1a00 con 0x7f08440c93a0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.486+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08441f1fc0 con 0x7f08440c93a0 2024-04-25T12:50:13.487 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.487+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0844068da0 con 0x7f08440c93a0 2024-04-25T12:50:13.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.487+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f083c01d070 con 0x7f08440c93a0 2024-04-25T12:50:13.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.488+0000 7f083a7fc640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f082806c8f0 0x7f082806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:13.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.488+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f083c08bd30 con 0x7f08440c93a0 2024-04-25T12:50:13.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.488+0000 7f08499c6640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f082806c8f0 0x7f082806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:13.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.488+0000 7f08499c6640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f082806c8f0 0x7f082806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f08400015a0 tx=0x7f0840009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:13.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.492+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f083c010070 con 0x7f08440c93a0 2024-04-25T12:50:13.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:13.675+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f08440cc480 con 0x7f08440c93a0 2024-04-25T12:50:14.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.351+0000 7f083a7fc640 1 -- 172.21.15.132:0/2571500754 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f083c05a1f0 con 0x7f08440c93a0 2024-04-25T12:50:14.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f082806c8f0 msgr2=0x7f082806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f082806c8f0 0x7f082806edb0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f08400015a0 tx=0x7f0840009040 comp rx=0 tx=0).stop 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 msgr2=0x7f0844158260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 0x7f0844158260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f083c007ea0 tx=0x7f083c007f90 comp rx=0 tx=0).stop 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 shutdown_connections 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f082806c8f0 0x7f082806edb0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08440c93a0 0x7f0844158260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f08440c8130 0x7f084415b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 --2- 172.21.15.132:0/2571500754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f08440c7d50 0x7f08441f1150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 >> 172.21.15.132:0/2571500754 conn(0x7f0844067810 msgr2=0x7f0844067bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 shutdown_connections 2024-04-25T12:50:14.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.354+0000 7f084bc2a640 1 -- 172.21.15.132:0/2571500754 wait complete. 2024-04-25T12:50:14.365 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T12:50:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.474+0000 7fdce59a2640 1 Processor -- start 2024-04-25T12:50:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.474+0000 7fdce59a2640 1 -- start start 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.474+0000 7fdce59a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdce00ceda0 0x7fdce0073a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdce59a2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdce015c840 0x7fdce0155280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdce59a2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce015bca0 con 0x7fdce00cf180 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdce59a2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fdce006c260 con 0x7fdce00ceda0 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdce59a2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdce015bf60 con 0x7fdce015c840 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcdeffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdce00ceda0 0x7fdce0073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcde7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdce00cf180 0x7fdce015b3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34562/0 (socket says 172.21.15.132:34562) 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcde7fc640 1 -- 172.21.15.132:0/2711503381 learned_addr learned my addr 172.21.15.132:0/2711503381 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcdf7fe640 1 --2- 172.21.15.132:0/2711503381 >> v2:172.21.15.157:3300/0 conn(0x7fdce015c840 0x7fdce0155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcdeffd640 1 -- 172.21.15.132:0/2711503381 >> v2:172.21.15.157:3300/0 conn(0x7fdce015c840 msgr2=0x7fdce0155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcdeffd640 1 --2- 172.21.15.132:0/2711503381 >> v2:172.21.15.157:3300/0 conn(0x7fdce015c840 0x7fdce0155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcdeffd640 1 -- 172.21.15.132:0/2711503381 >> v1:172.21.15.132:6789/0 conn(0x7fdce00cf180 legacy=0x7fdce015b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcddffb640 1 -- 172.21.15.132:0/2711503381 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438481162 0 0) 0x7fdce015bca0 con 0x7fdce00cf180 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.475+0000 7fdcdeffd640 1 -- 172.21.15.132:0/2711503381 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce015c240 con 0x7fdce00ceda0 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdcdeffd640 1 --2- 172.21.15.132:0/2711503381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce00ceda0 0x7fdce0073a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdce006c3e0 tx=0x7fdcd802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5517edffd7e0384 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdcddffb640 1 -- 172.21.15.132:0/2711503381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8037070 con 0x7fdce00ceda0 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdcddffb640 1 -- 172.21.15.132:0/2711503381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd8032440 con 0x7fdce00ceda0 2024-04-25T12:50:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdcddffb640 1 -- 172.21.15.132:0/2711503381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd8032810 con 0x7fdce00ceda0 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 -- 172.21.15.132:0/2711503381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce00ceda0 msgr2=0x7fdce0073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 --2- 172.21.15.132:0/2711503381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce00ceda0 0x7fdce0073a20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdce006c3e0 tx=0x7fdcd802a230 comp rx=0 tx=0).stop 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 -- 172.21.15.132:0/2711503381 shutdown_connections 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 --2- 172.21.15.132:0/2711503381 >> v2:172.21.15.157:3300/0 conn(0x7fdce015c840 0x7fdce0155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 --2- 172.21.15.132:0/2711503381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce00ceda0 0x7fdce0073a20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 -- 172.21.15.132:0/2711503381 >> 172.21.15.132:0/2711503381 conn(0x7fdce0067630 msgr2=0x7fdce0067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 -- 172.21.15.132:0/2711503381 shutdown_connections 2024-04-25T12:50:14.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.476+0000 7fdce59a2640 1 -- 172.21.15.132:0/2711503381 wait complete. 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.477+0000 7fdce59a2640 1 Processor -- start 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 -- start start 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce00ceda0 0x7fdce01f4890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdce00cf180 0x7fdce01437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 0x7fdce01566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdce006bef0 con 0x7fdce015c840 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdce006bc10 con 0x7fdce00cf180 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdce59a2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdce006c6f0 con 0x7fdce00ceda0 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdcdf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 0x7fdce01566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdcdf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 0x7fdce01566e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55840/0 (socket says 172.21.15.132:55840) 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.478+0000 7fdcdf7fe640 1 -- 172.21.15.132:0/1693472023 learned_addr learned my addr 172.21.15.132:0/1693472023 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcde7fc640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdce00cf180 0x7fdce01437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdeffd640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce00ceda0 0x7fdce01f4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:14.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdf7fe640 1 -- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce00ceda0 msgr2=0x7fdce01f4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdf7fe640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce00ceda0 0x7fdce01f4890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdf7fe640 1 -- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdce00cf180 msgr2=0x7fdce01437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdf7fe640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdce00cf180 0x7fdce01437c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdf7fe640 1 -- 172.21.15.132:0/1693472023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce01f4dd0 con 0x7fdce015c840 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcdf7fe640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 0x7fdce01566e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000d830 tx=0x7fdcd000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000b6c0 con 0x7fdce015c840 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcd0019070 con 0x7fdce015c840 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcd000bac0 con 0x7fdce015c840 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdce00be820 con 0x7fdce015c840 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.479+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdce0157c10 con 0x7fdce015c840 2024-04-25T12:50:14.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.480+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdce00741e0 con 0x7fdce015c840 2024-04-25T12:50:14.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.480+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdcd001e460 con 0x7fdce015c840 2024-04-25T12:50:14.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.481+0000 7fdcc7fff640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdccc06c8f0 0x7fdccc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:14.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.481+0000 7fdcdeffd640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdccc06c8f0 0x7fdccc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:14.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.481+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fdcd008c2d0 con 0x7fdce015c840 2024-04-25T12:50:14.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.481+0000 7fdcdeffd640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdccc06c8f0 0x7fdccc06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8034000 tx=0x7fdcd802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:14.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.485+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdcd005a5d0 con 0x7fdce015c840 2024-04-25T12:50:14.659 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:14.661+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fdce00c6520 con 0x7fdce015c840 2024-04-25T12:50:16.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.364+0000 7fdcc7fff640 1 -- 172.21.15.132:0/1693472023 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fdcd0059ed0 con 0x7fdce015c840 2024-04-25T12:50:16.362 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data_ec' created 2024-04-25T12:50:16.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdccc06c8f0 msgr2=0x7fdccc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:16.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdccc06c8f0 0x7fdccc06edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdcd8034000 tx=0x7fdcd802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:16.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 msgr2=0x7fdce01566e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 0x7fdce01566e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdcd000d830 tx=0x7fdcd000dcf0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 shutdown_connections 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdccc06c8f0 0x7fdccc06edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdce015c840 0x7fdce01566e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdce00cf180 0x7fdce01437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 --2- 172.21.15.132:0/1693472023 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdce00ceda0 0x7fdce01f4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.368+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 >> 172.21.15.132:0/1693472023 conn(0x7fdce0067630 msgr2=0x7fdce00cbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:16.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.369+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 shutdown_connections 2024-04-25T12:50:16.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.369+0000 7fdce59a2640 1 -- 172.21.15.132:0/1693472023 wait complete. 2024-04-25T12:50:16.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-25T12:50:16.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.492+0000 7f30372a0640 1 Processor -- start 2024-04-25T12:50:16.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.492+0000 7f30372a0640 1 -- start start 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f30372a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30300c91a0 0x7f303006d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f30372a0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f303015f090 0x7f30301553b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f30372a0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f303006c7e0 con 0x7f303015ecb0 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f30372a0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f303006d790 con 0x7f303015f090 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f30372a0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f303006cdc0 con 0x7f30300c91a0 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303483b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30300c91a0 0x7f303006d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303583d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f303015f090 0x7f30301553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303483b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30300c91a0 0x7f303006d250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:47552/0 (socket says 172.21.15.132:47552) 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303483b640 1 -- 172.21.15.132:0/2834289511 learned_addr learned my addr 172.21.15.132:0/2834289511 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303583d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f303015f090 0x7f30301553b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:33154/0 (socket says 172.21.15.132:33154) 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303583d640 1 -- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30300c91a0 msgr2=0x7f303006d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:16.492 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303583d640 1 --2- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30300c91a0 0x7f303006d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f303583d640 1 -- 172.21.15.132:0/2834289511 >> v1:172.21.15.157:6789/0 conn(0x7f303015ecb0 legacy=0x7f30300c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:16.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.493+0000 7f3027fff640 1 -- 172.21.15.132:0/2834289511 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188118325 0 0) 0x7f303006c7e0 con 0x7f303015ecb0 2024-04-25T12:50:16.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.494+0000 7f303583d640 1 -- 172.21.15.132:0/2834289511 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30300c5e40 con 0x7f303015f090 2024-04-25T12:50:16.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.494+0000 7f303583d640 1 --2- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f303015f090 0x7f30301553b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f303006cf40 tx=0x7f302802a6d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a895e0f76d746829 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:16.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.494+0000 7f3027fff640 1 -- 172.21.15.132:0/2834289511 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028007740 con 0x7f303015f090 2024-04-25T12:50:16.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.494+0000 7f3027fff640 1 -- 172.21.15.132:0/2834289511 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30280078e0 con 0x7f303015f090 2024-04-25T12:50:16.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.494+0000 7f3027fff640 1 -- 172.21.15.132:0/2834289511 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028007cb0 con 0x7f303015f090 2024-04-25T12:50:16.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 -- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f303015f090 msgr2=0x7f30301553b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 --2- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f303015f090 0x7f30301553b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f303006cf40 tx=0x7f302802a6d0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 -- 172.21.15.132:0/2834289511 shutdown_connections 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 --2- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f303015f090 0x7f30301553b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 --2- 172.21.15.132:0/2834289511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f30300c91a0 0x7f303006d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 -- 172.21.15.132:0/2834289511 >> 172.21.15.132:0/2834289511 conn(0x7f30300d0dc0 msgr2=0x7f30300d11d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 -- 172.21.15.132:0/2834289511 shutdown_connections 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.495+0000 7f30372a0640 1 -- 172.21.15.132:0/2834289511 wait complete. 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.496+0000 7f30372a0640 1 Processor -- start 2024-04-25T12:50:16.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.496+0000 7f30372a0640 1 -- start start 2024-04-25T12:50:16.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f30372a0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30300c91a0 0x7f303014c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:16.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f30372a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f303015ecb0 0x7f30301f1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:16.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f30372a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 0x7f303015d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:16.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f30372a0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f30300c5840 con 0x7f303015f090 2024-04-25T12:50:16.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f30372a0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f303006ca50 con 0x7f30300c91a0 2024-04-25T12:50:16.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f30372a0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f30300c6400 con 0x7f303015ecb0 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 0x7f303015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 0x7f303015d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55850/0 (socket says 172.21.15.132:55850) 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 -- 172.21.15.132:0/3906441002 learned_addr learned my addr 172.21.15.132:0/3906441002 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303503c640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30300c91a0 0x7f303014c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303483b640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f303015ecb0 0x7f30301f1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 -- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f303015ecb0 msgr2=0x7f30301f1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f303015ecb0 0x7f30301f1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 -- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30300c91a0 msgr2=0x7f303014c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30300c91a0 0x7f303014c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 -- 172.21.15.132:0/3906441002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30301f1fc0 con 0x7f303015f090 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.497+0000 7f303583d640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 0x7f303015d890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f302802acc0 tx=0x7f3028004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.498+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f302803f070 con 0x7f303015f090 2024-04-25T12:50:16.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.498+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3028031c40 con 0x7f303015f090 2024-04-25T12:50:16.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.498+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3028009450 con 0x7f303015f090 2024-04-25T12:50:16.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.498+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f303014cc10 con 0x7f303015f090 2024-04-25T12:50:16.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.498+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f303015aaa0 con 0x7f303015f090 2024-04-25T12:50:16.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.499+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3030069e70 con 0x7f303015f090 2024-04-25T12:50:16.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.499+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3028003990 con 0x7f303015f090 2024-04-25T12:50:16.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.500+0000 7f3025ffb640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:16.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.500+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f30280ace00 con 0x7f303015f090 2024-04-25T12:50:16.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.500+0000 7f303503c640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f301406c8f0 0x7f301406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:16.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.500+0000 7f303503c640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f302c000f60 tx=0x7f302c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:16.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.504+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3030069e70 con 0x7f303015f090 2024-04-25T12:50:16.675 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:16.677+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f3030068da0 con 0x7f303015f090 2024-04-25T12:50:17.367 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.368+0000 7f3025ffb640 1 -- 172.21.15.132:0/3906441002 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7f302807a950 con 0x7f303015f090 2024-04-25T12:50:17.367 INFO:teuthology.orchestra.run.smithi132.stderr:set pool 4 allow_ec_overwrites to true 2024-04-25T12:50:17.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f301406c8f0 msgr2=0x7f301406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:17.370 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f302c000f60 tx=0x7f302c009040 comp rx=0 tx=0).stop 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 msgr2=0x7f303015d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 0x7f303015d890 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f302802acc0 tx=0x7f3028004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 shutdown_connections 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f301406c8f0 0x7f301406edb0 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f302c000f60 tx=0x7f302c009040 comp rx=0 tx=0).stop 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303015f090 0x7f303015d890 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f303015ecb0 0x7f30301f1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 --2- 172.21.15.132:0/3906441002 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f30300c91a0 0x7f303014c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 >> 172.21.15.132:0/3906441002 conn(0x7f30300d0dc0 msgr2=0x7f30300c7070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 shutdown_connections 2024-04-25T12:50:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.371+0000 7f30372a0640 1 -- 172.21.15.132:0/3906441002 wait complete. 2024-04-25T12:50:17.398 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-25T12:50:17.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.501+0000 7fd4345bf640 1 Processor -- start 2024-04-25T12:50:17.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.501+0000 7fd4345bf640 1 -- start start 2024-04-25T12:50:17.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd4345bf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd42c13b8d0 0x7fd42c073a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:17.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd4345bf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c1590a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd4345bf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd42c13e2a0 con 0x7fd42c0c8560 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd4345bf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd42c13e540 con 0x7fd42c13b8d0 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd4345bf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd42c13e820 con 0x7fd42c0c89f0 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd43235b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd42c13b8d0 0x7fd42c073a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd431b5a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd42c0c8560 0x7fd42c0c99e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34574/0 (socket says 172.21.15.132:34574) 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.502+0000 7fd431b5a640 1 -- 172.21.15.132:0/3179970789 learned_addr learned my addr 172.21.15.132:0/3179970789 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd432b5c640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c1590a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd43235b640 1 -- 172.21.15.132:0/3179970789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 msgr2=0x7fd42c1590a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd43235b640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c1590a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd431359640 1 -- 172.21.15.132:0/3179970789 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1746643065 0 0) 0x7fd42c13e2a0 con 0x7fd42c0c8560 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd43235b640 1 -- 172.21.15.132:0/3179970789 >> v1:172.21.15.132:6789/0 conn(0x7fd42c0c8560 legacy=0x7fd42c0c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd43235b640 1 -- 172.21.15.132:0/3179970789 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c13eb00 con 0x7fd42c13b8d0 2024-04-25T12:50:17.503 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd432b5c640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:17.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd43235b640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c073a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd428009d90 tx=0x7fd42802a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25bf1e1735a521aa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:17.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd431359640 1 -- 172.21.15.132:0/3179970789 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428007740 con 0x7fd42c13b8d0 2024-04-25T12:50:17.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd431359640 1 -- 172.21.15.132:0/3179970789 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4280078e0 con 0x7fd42c13b8d0 2024-04-25T12:50:17.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.503+0000 7fd431359640 1 -- 172.21.15.132:0/3179970789 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd428007cb0 con 0x7fd42c13b8d0 2024-04-25T12:50:17.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 -- 172.21.15.132:0/3179970789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 msgr2=0x7fd42c073a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:17.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c073a20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd428009d90 tx=0x7fd42802a660 comp rx=0 tx=0).stop 2024-04-25T12:50:17.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 -- 172.21.15.132:0/3179970789 shutdown_connections 2024-04-25T12:50:17.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c1590a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 --2- 172.21.15.132:0/3179970789 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c073a20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 -- 172.21.15.132:0/3179970789 >> 172.21.15.132:0/3179970789 conn(0x7fd42c067630 msgr2=0x7fd42c067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 -- 172.21.15.132:0/3179970789 shutdown_connections 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.504+0000 7fd4345bf640 1 -- 172.21.15.132:0/3179970789 wait complete. 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.505+0000 7fd4345bf640 1 Processor -- start 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.505+0000 7fd4345bf640 1 -- start start 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c0c8560 0x7fd42c1410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c13a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0ca270 con 0x7fd42c13b8d0 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd42c0ca0f0 con 0x7fd42c0c8560 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd42c13bcb0 con 0x7fd42c0c89f0 2024-04-25T12:50:17.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c13a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c13a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55858/0 (socket says 172.21.15.132:55858) 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 -- 172.21.15.132:0/2751958384 learned_addr learned my addr 172.21.15.132:0/2751958384 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd431b5a640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd43235b640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c0c8560 0x7fd42c1410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 -- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 msgr2=0x7fd42c155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c155eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 -- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c0c8560 msgr2=0x7fd42c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c0c8560 0x7fd42c1410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 -- 172.21.15.132:0/2751958384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd42c141b00 con 0x7fd42c13b8d0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd432b5c640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c13a100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c7f0 tx=0x7fd42400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424015070 con 0x7fd42c13b8d0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd424007820 con 0x7fd42c13b8d0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd42c13b070 con 0x7fd42c13b8d0 2024-04-25T12:50:17.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd424007c50 con 0x7fd42c13b8d0 2024-04-25T12:50:17.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.506+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd42c140620 con 0x7fd42c13b8d0 2024-04-25T12:50:17.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.507+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd42c0741e0 con 0x7fd42c13b8d0 2024-04-25T12:50:17.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.508+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd424018070 con 0x7fd42c13b8d0 2024-04-25T12:50:17.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.508+0000 7fd422ffd640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd41006c920 0x7fd41006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:17.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.508+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7fd42408bf40 con 0x7fd42c13b8d0 2024-04-25T12:50:17.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.508+0000 7fd43235b640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd41006c920 0x7fd41006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:17.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.509+0000 7fd43235b640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd41006c920 0x7fd41006ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd428034000 tx=0x7fd42802f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:17.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.513+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd42405a0e0 con 0x7fd42c13b8d0 2024-04-25T12:50:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:17.727+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fd42c1381e0 con 0x7fd42c13b8d0 2024-04-25T12:50:18.375 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.376+0000 7fd422ffd640 1 -- 172.21.15.132:0/2751958384 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7fd4240599e0 con 0x7fd42c13b8d0 2024-04-25T12:50:18.375 INFO:teuthology.orchestra.run.smithi132.stderr:added data pool 4 to fsmap 2024-04-25T12:50:18.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd41006c920 msgr2=0x7fd41006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd41006c920 0x7fd41006ede0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd428034000 tx=0x7fd42802f000 comp rx=0 tx=0).stop 2024-04-25T12:50:18.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 msgr2=0x7fd42c13a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c13a100 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd42400c7f0 tx=0x7fd42400ccb0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 shutdown_connections 2024-04-25T12:50:18.378 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd41006c920 0x7fd41006ede0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd42c13b8d0 0x7fd42c13a100 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd42c0c89f0 0x7fd42c155eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 --2- 172.21.15.132:0/2751958384 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd42c0c8560 0x7fd42c1410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 >> 172.21.15.132:0/2751958384 conn(0x7fd42c067630 msgr2=0x7fd42c1e53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 shutdown_connections 2024-04-25T12:50:18.379 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.379+0000 7fd4345bf640 1 -- 172.21.15.132:0/2751958384 wait complete. 2024-04-25T12:50:18.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:18.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.490+0000 7fa1f814a640 1 Processor -- start 2024-04-25T12:50:18.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.490+0000 7fa1f814a640 1 -- start start 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f814a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c7a60 0x7fa1f00c82e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f814a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1f0070150 0x7fa1f0067630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f814a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f0071e80 con 0x7fa1f0067b70 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f814a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f00c7e40 con 0x7fa1f0070150 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f814a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f00c8820 con 0x7fa1f00c7a60 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f56e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1f0070150 0x7fa1f0067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f56e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1f0070150 0x7fa1f0067630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55874/0 (socket says 172.21.15.132:55874) 2024-04-25T12:50:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f56e5640 1 -- 172.21.15.132:0/3298938192 learned_addr learned my addr 172.21.15.132:0/3298938192 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.491+0000 7fa1f5ee6640 1 --2- 172.21.15.132:0/3298938192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c7a60 0x7fa1f00c82e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f56e5640 1 -- 172.21.15.132:0/3298938192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c7a60 msgr2=0x7fa1f00c82e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f56e5640 1 --2- 172.21.15.132:0/3298938192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c7a60 0x7fa1f00c82e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f56e5640 1 -- 172.21.15.132:0/3298938192 >> v1:172.21.15.157:6789/0 conn(0x7fa1f0067b70 legacy=0x7fa1f00c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f56e5640 1 -- 172.21.15.132:0/3298938192 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f015c0f0 con 0x7fa1f0070150 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f56e5640 1 --2- 172.21.15.132:0/3298938192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f0067630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87cf4300d134f67e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f4ee4640 1 -- 172.21.15.132:0/3298938192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0037070 con 0x7fa1f0070150 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f4ee4640 1 -- 172.21.15.132:0/3298938192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e002ae50 con 0x7fa1f0070150 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.492+0000 7fa1f4ee4640 1 -- 172.21.15.132:0/3298938192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0032860 con 0x7fa1f0070150 2024-04-25T12:50:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 -- 172.21.15.132:0/3298938192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 msgr2=0x7fa1f0067630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 --2- 172.21.15.132:0/3298938192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f0067630 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0009870 tx=0x7fa1e002a300 comp rx=0 tx=0).stop 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 -- 172.21.15.132:0/3298938192 shutdown_connections 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 --2- 172.21.15.132:0/3298938192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f0067630 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 --2- 172.21.15.132:0/3298938192 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f00c7a60 0x7fa1f00c82e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 -- 172.21.15.132:0/3298938192 >> 172.21.15.132:0/3298938192 conn(0x7fa1f006da70 msgr2=0x7fa1f006de50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 -- 172.21.15.132:0/3298938192 shutdown_connections 2024-04-25T12:50:18.495 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.493+0000 7fa1f814a640 1 -- 172.21.15.132:0/3298938192 wait complete. 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.494+0000 7fa1f814a640 1 Processor -- start 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.494+0000 7fa1f814a640 1 -- start start 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f814a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f0067b70 0x7fa1f01e7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f814a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f01e8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f814a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c7a60 0x7fa1f01511c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f814a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0072420 con 0x7fa1f0070150 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f814a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f0072a70 con 0x7fa1f00c7a60 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f814a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f0072700 con 0x7fa1f0067b70 2024-04-25T12:50:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f01e8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f01e8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55880/0 (socket says 172.21.15.132:55880) 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 -- 172.21.15.132:0/1909512137 learned_addr learned my addr 172.21.15.132:0/1909512137 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f66e7640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c7a60 0x7fa1f01511c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 -- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f0067b70 msgr2=0x7fa1f01e7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f5ee6640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f0067b70 0x7fa1f01e7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f0067b70 0x7fa1f01e7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 -- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c7a60 msgr2=0x7fa1f01511c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c7a60 0x7fa1f01511c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 -- 172.21.15.132:0/1909512137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f01e75a0 con 0x7fa1f0070150 2024-04-25T12:50:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1f56e5640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f01e8190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0000c00 tx=0x7fa1e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0041020 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.495+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e003c870 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.496+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f01e6a60 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.496+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0037040 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.496+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f01e6fe0 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.496+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f015bcb0 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.497+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1e0044020 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.497+0000 7fa1e67fc640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1d406c8f0 0x7fa1d406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.497+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1e00ac430 con 0x7fa1f0070150 2024-04-25T12:50:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.497+0000 7fa1f5ee6640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1d406c8f0 0x7fa1d406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.498+0000 7fa1f5ee6640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1d406c8f0 0x7fa1d406edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009970 tx=0x7fa1ec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.502+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa1f015bcb0 con 0x7fa1f0070150 2024-04-25T12:50:18.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.711+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1f00741e0 con 0x7fa1f0070150 2024-04-25T12:50:18.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.712+0000 7fa1e67fc640 1 -- 172.21.15.132:0/1909512137 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6835 (secure 0 0 0) 0x7fa1e004b070 con 0x7fa1f0070150 2024-04-25T12:50:18.711 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:18.711 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:17.729914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-25T12:50:18.712 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 5 2024-04-25T12:50:18.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1d406c8f0 msgr2=0x7fa1d406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1d406c8f0 0x7fa1d406edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009970 tx=0x7fa1ec008040 comp rx=0 tx=0).stop 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 msgr2=0x7fa1f01e8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f01e8190 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1e0000c00 tx=0x7fa1e00046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 shutdown_connections 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1d406c8f0 0x7fa1d406edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f00c7a60 0x7fa1f01511c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0070150 0x7fa1f01e8190 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 --2- 172.21.15.132:0/1909512137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa1f0067b70 0x7fa1f01e7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 >> 172.21.15.132:0/1909512137 conn(0x7fa1f006da70 msgr2=0x7fa1f00cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 shutdown_connections 2024-04-25T12:50:18.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.714+0000 7fa1f814a640 1 -- 172.21.15.132:0/1909512137 wait complete. 2024-04-25T12:50:18.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:18.820 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.821+0000 7fa78f6cf640 1 Processor -- start 2024-04-25T12:50:18.821 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.822+0000 7fa78f6cf640 1 -- start start 2024-04-25T12:50:18.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.822+0000 7fa78f6cf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7880cc140 0x7fa78806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.822+0000 7fa78f6cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880cc730 0x7fa78806cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.822+0000 7fa78f6cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa78815ed80 con 0x7fa7881557e0 2024-04-25T12:50:18.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.822+0000 7fa78f6cf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa7880cb5a0 con 0x7fa7880cc140 2024-04-25T12:50:18.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.822+0000 7fa78f6cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa78815f060 con 0x7fa7880cc730 2024-04-25T12:50:18.822 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78cc6a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7880cc140 0x7fa78806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78d46b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa7881557e0 0x7fa7880cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34576/0 (socket says 172.21.15.132:34576) 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78d46b640 1 -- 172.21.15.132:0/530314910 learned_addr learned my addr 172.21.15.132:0/530314910 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78dc6c640 1 --2- 172.21.15.132:0/530314910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880cc730 0x7fa78806cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78cc6a640 1 -- 172.21.15.132:0/530314910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880cc730 msgr2=0x7fa78806cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78cc6a640 1 --2- 172.21.15.132:0/530314910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880cc730 0x7fa78806cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78cc6a640 1 -- 172.21.15.132:0/530314910 >> v1:172.21.15.132:6789/0 conn(0x7fa7881557e0 legacy=0x7fa7880cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa77ffff640 1 -- 172.21.15.132:0/530314910 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2809062136 0 0) 0x7fa78815ed80 con 0x7fa7881557e0 2024-04-25T12:50:18.823 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.823+0000 7fa78cc6a640 1 -- 172.21.15.132:0/530314910 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78815f340 con 0x7fa7880cc140 2024-04-25T12:50:18.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78cc6a640 1 --2- 172.21.15.132:0/530314910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc140 0x7fa78806c9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa7840097a0 tx=0x7fa78402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf3e25d778cb6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:18.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa77ffff640 1 -- 172.21.15.132:0/530314910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784037070 con 0x7fa7880cc140 2024-04-25T12:50:18.824 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa77ffff640 1 -- 172.21.15.132:0/530314910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa784032440 con 0x7fa7880cc140 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa77ffff640 1 -- 172.21.15.132:0/530314910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784032810 con 0x7fa7880cc140 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 -- 172.21.15.132:0/530314910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc140 msgr2=0x7fa78806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/530314910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc140 0x7fa78806c9c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa7840097a0 tx=0x7fa78402a180 comp rx=0 tx=0).stop 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 -- 172.21.15.132:0/530314910 shutdown_connections 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/530314910 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7880cc730 0x7fa78806cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/530314910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc140 0x7fa78806c9c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 -- 172.21.15.132:0/530314910 >> 172.21.15.132:0/530314910 conn(0x7fa7880d0e10 msgr2=0x7fa7880d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 -- 172.21.15.132:0/530314910 shutdown_connections 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.824+0000 7fa78f6cf640 1 -- 172.21.15.132:0/530314910 wait complete. 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.825+0000 7fa78f6cf640 1 Processor -- start 2024-04-25T12:50:18.825 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.825+0000 7fa78f6cf640 1 -- start start 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78f6cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7880cc140 0x7fa7880cf450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78f6cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 0x7fa78815d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78f6cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7881557e0 0x7fa78815d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78f6cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa7880cd240 con 0x7fa7880cc730 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78f6cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa7880cd0c0 con 0x7fa7880cc140 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78f6cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa78815e920 con 0x7fa7881557e0 2024-04-25T12:50:18.827 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78cc6a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 0x7fa78815d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78cc6a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 0x7fa78815d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55900/0 (socket says 172.21.15.132:55900) 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78cc6a640 1 -- 172.21.15.132:0/1840190644 learned_addr learned my addr 172.21.15.132:0/1840190644 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78d46b640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7880cc140 0x7fa7880cf450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.826+0000 7fa78dc6c640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7881557e0 0x7fa78815d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78cc6a640 1 -- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7881557e0 msgr2=0x7fa78815d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78cc6a640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7881557e0 0x7fa78815d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78cc6a640 1 -- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7880cc140 msgr2=0x7fa7880cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78cc6a640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7880cc140 0x7fa7880cf450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78cc6a640 1 -- 172.21.15.132:0/1840190644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7881f1c70 con 0x7fa7880cc730 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78dc6c640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7881557e0 0x7fa78815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa78cc6a640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 0x7fa78815d090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7840096f0 tx=0x7fa7840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.827+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784037040 con 0x7fa7880cc730 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.828+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7881f1f10 con 0x7fa7880cc730 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.828+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78815c890 con 0x7fa7880cc730 2024-04-25T12:50:18.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.828+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa784042070 con 0x7fa7880cc730 2024-04-25T12:50:18.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.828+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784030b70 con 0x7fa7880cc730 2024-04-25T12:50:18.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.829+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa788068c20 con 0x7fa7880cc730 2024-04-25T12:50:18.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.829+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa784030d10 con 0x7fa7880cc730 2024-04-25T12:50:18.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.829+0000 7fa77dffb640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa76c06c8f0 0x7fa76c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:18.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.830+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa7840ac8a0 con 0x7fa7880cc730 2024-04-25T12:50:18.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.830+0000 7fa78d46b640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa76c06c8f0 0x7fa76c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:18.830 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.830+0000 7fa78d46b640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa76c06c8f0 0x7fa76c06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa778007fd0 tx=0x7fa778007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:18.833 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:18.834+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa784032e20 con 0x7fa7880cc730 2024-04-25T12:50:19.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.009+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa7880cbd10 con 0x7fa7880cc730 2024-04-25T12:50:19.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.010+0000 7fa77dffb640 1 -- 172.21.15.132:0/1840190644 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7fa78407a9a0 con 0x7fa7880cc730 2024-04-25T12:50:19.009 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:19.009 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:19.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa76c06c8f0 msgr2=0x7fa76c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa76c06c8f0 0x7fa76c06edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa778007fd0 tx=0x7fa778007de0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 msgr2=0x7fa78815d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 0x7fa78815d090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa7840096f0 tx=0x7fa7840046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 shutdown_connections 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa76c06c8f0 0x7fa76c06edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa7881557e0 0x7fa78815d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7880cc730 0x7fa78815d090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 --2- 172.21.15.132:0/1840190644 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa7880cc140 0x7fa7880cf450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 >> 172.21.15.132:0/1840190644 conn(0x7fa7880d0e10 msgr2=0x7fa7880c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 shutdown_connections 2024-04-25T12:50:19.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.012+0000 7fa78f6cf640 1 -- 172.21.15.132:0/1840190644 wait complete. 2024-04-25T12:50:19.022 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:19.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.120+0000 7f7e828cf640 1 Processor -- start 2024-04-25T12:50:19.119 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.120+0000 7f7e828cf640 1 -- start start 2024-04-25T12:50:19.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e828cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c155460 0x7f7e7c0cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e828cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7c15e9d0 con 0x7f7e7c0d13a0 2024-04-25T12:50:19.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e828cf640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7c15ecb0 con 0x7f7e7c15bec0 2024-04-25T12:50:19.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e828cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c0d1890 con 0x7f7e7c155460 2024-04-25T12:50:19.121 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e80e6c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7e7c0d13a0 0x7f7e7c0b4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34588/0 (socket says 172.21.15.132:34588) 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e80e6c640 1 -- 172.21.15.132:0/873792089 learned_addr learned my addr 172.21.15.132:0/873792089 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7bfff640 1 --2- 172.21.15.132:0/873792089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c155460 0x7f7e7c0cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632946481 0 0) 0x7f7e7c15e9d0 con 0x7f7e7c0d13a0 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e64003520 con 0x7f7e7c0d13a0 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762756677 0 0) 0x7f7e7c15ecb0 con 0x7f7e7c15bec0 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e7c15e9d0 con 0x7f7e7c15bec0 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7bfff640 1 -- 172.21.15.132:0/873792089 >> v1:172.21.15.157:6789/0 conn(0x7f7e7c15bec0 legacy=0x7f7e7c0d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7bfff640 1 -- 172.21.15.132:0/873792089 >> v1:172.21.15.132:6789/0 conn(0x7f7e7c0d13a0 legacy=0x7f7e7c0b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.121+0000 7f7e7bfff640 1 -- 172.21.15.132:0/873792089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c15ef90 con 0x7f7e7c155460 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.122+0000 7f7e7bfff640 1 --2- 172.21.15.132:0/873792089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c155460 0x7f7e7c0cba20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097d0 tx=0x7f7e6c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b99afda4f69b8c45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.122+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c037070 con 0x7f7e7c155460 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.122+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e6c032440 con 0x7f7e7c155460 2024-04-25T12:50:19.122 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.122+0000 7f7e7affd640 1 -- 172.21.15.132:0/873792089 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c0327f0 con 0x7f7e7c155460 2024-04-25T12:50:19.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 -- 172.21.15.132:0/873792089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c155460 msgr2=0x7f7e7c0cba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 --2- 172.21.15.132:0/873792089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c155460 0x7f7e7c0cba20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0097d0 tx=0x7f7e6c02a210 comp rx=0 tx=0).stop 2024-04-25T12:50:19.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 -- 172.21.15.132:0/873792089 shutdown_connections 2024-04-25T12:50:19.125 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 --2- 172.21.15.132:0/873792089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c155460 0x7f7e7c0cba20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 -- 172.21.15.132:0/873792089 >> 172.21.15.132:0/873792089 conn(0x7f7e7c067810 msgr2=0x7f7e7c067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 -- 172.21.15.132:0/873792089 shutdown_connections 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.123+0000 7f7e828cf640 1 -- 172.21.15.132:0/873792089 wait complete. 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.124+0000 7f7e828cf640 1 Processor -- start 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.124+0000 7f7e828cf640 1 -- start start 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e7c0d13a0 0x7f7e7c0c6290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 0x7f7e7c0c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c15bec0 0x7f7e7c15db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c155840 con 0x7f7e7c155460 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7e7c15f550 con 0x7f7e7c0d13a0 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7e7c1559c0 con 0x7f7e7c15bec0 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 0x7f7e7c0c7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 0x7f7e7c0c7220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55908/0 (socket says 172.21.15.132:55908) 2024-04-25T12:50:19.126 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 -- 172.21.15.132:0/2924532660 learned_addr learned my addr 172.21.15.132:0/2924532660 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7bfff640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e7c0d13a0 0x7f7e7c0c6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e80e6c640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c15bec0 0x7f7e7c15db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 -- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c15bec0 msgr2=0x7f7e7c15db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c15bec0 0x7f7e7c15db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 -- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e7c0d13a0 msgr2=0x7f7e7c0c6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e7c0d13a0 0x7f7e7c0c6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 -- 172.21.15.132:0/2924532660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7c15a440 con 0x7f7e7c155460 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e7b7fe640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 0x7f7e7c0c7220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c3c0 tx=0x7f7e7000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70017070 con 0x7f7e7c155460 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e700052f0 con 0x7f7e7c155460 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70003680 con 0x7f7e7c155460 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.125+0000 7f7e828cf640 1 -- 172.21.15.132:0/2924532660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e7c15a720 con 0x7f7e7c155460 2024-04-25T12:50:19.127 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.126+0000 7f7e828cf640 1 -- 172.21.15.132:0/2924532660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e7c15ace0 con 0x7f7e7c155460 2024-04-25T12:50:19.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.127+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e54005290 con 0x7f7e7c155460 2024-04-25T12:50:19.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.127+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7e7001a070 con 0x7f7e7c155460 2024-04-25T12:50:19.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.127+0000 7f7e78ff9640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7e6806c920 0x7f7e6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.128 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.127+0000 7f7e7bfff640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7e6806c920 0x7f7e6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.128+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7e7008b150 con 0x7f7e7c155460 2024-04-25T12:50:19.129 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.128+0000 7f7e7bfff640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7e6806c920 0x7f7e6806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c034000 tx=0x7f7e6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.131 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.132+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e70058cb0 con 0x7f7e7c155460 2024-04-25T12:50:19.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.311+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7e54005850 con 0x7f7e7c155460 2024-04-25T12:50:19.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.312+0000 7f7e78ff9640 1 -- 172.21.15.132:0/2924532660 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f7e7005cfb0 con 0x7f7e7c155460 2024-04-25T12:50:19.311 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:19.312 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7e6806c920 msgr2=0x7f7e6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7e6806c920 0x7f7e6806ede0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c034000 tx=0x7f7e6c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 msgr2=0x7f7e7c0c7220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 0x7f7e7c0c7220 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7e7000c3c0 tx=0x7f7e7000c880 comp rx=0 tx=0).stop 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 shutdown_connections 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7e6806c920 0x7f7e6806ede0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7e7c15bec0 0x7f7e7c15db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e7c155460 0x7f7e7c0c7220 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 --2- 172.21.15.132:0/2924532660 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7e7c0d13a0 0x7f7e7c0c6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 >> 172.21.15.132:0/2924532660 conn(0x7f7e7c067810 msgr2=0x7f7e7c152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 shutdown_connections 2024-04-25T12:50:19.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.314+0000 7f7e627fc640 1 -- 172.21.15.132:0/2924532660 wait complete. 2024-04-25T12:50:19.339 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.437+0000 7fe800c49640 1 Processor -- start 2024-04-25T12:50:19.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.437+0000 7fe800c49640 1 -- start start 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe800c49640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7fc153370 0x7fe7fc15d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe800c49640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc159440 con 0x7fe7fc159000 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe800c49640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7fc153750 con 0x7fe7fc073890 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe800c49640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe7fc0c64b0 con 0x7fe7fc153370 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe7fa59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7fc153370 0x7fe7fc15d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe7fa59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe7fc153370 0x7fe7fc15d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55918/0 (socket says 172.21.15.132:55918) 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe7f9d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe7fc159000 0x7fe7fc0c5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34600/0 (socket says 172.21.15.132:34600) 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.438+0000 7fe7fa59c640 1 -- 172.21.15.132:0/1204584647 learned_addr learned my addr 172.21.15.132:0/1204584647 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:19.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7fa59c640 1 -- 172.21.15.132:0/1204584647 >> v1:172.21.15.157:6789/0 conn(0x7fe7fc073890 legacy=0x7fe7fc0c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7fa59c640 1 -- 172.21.15.132:0/1204584647 >> v1:172.21.15.132:6789/0 conn(0x7fe7fc159000 legacy=0x7fe7fc0c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7f959a640 1 -- 172.21.15.132:0/1204584647 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947439688 0 0) 0x7fe7fc159440 con 0x7fe7fc159000 2024-04-25T12:50:19.439 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7fa59c640 1 -- 172.21.15.132:0/1204584647 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc0c6790 con 0x7fe7fc153370 2024-04-25T12:50:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7fa59c640 1 --2- 172.21.15.132:0/1204584647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc15d170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009e50 tx=0x7fe7ec02a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5592db46e5e456 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7f959a640 1 -- 172.21.15.132:0/1204584647 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec036070 con 0x7fe7fc153370 2024-04-25T12:50:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7f959a640 1 -- 172.21.15.132:0/1204584647 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7ec031600 con 0x7fe7fc153370 2024-04-25T12:50:19.440 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.439+0000 7fe7f959a640 1 -- 172.21.15.132:0/1204584647 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7ec0319d0 con 0x7fe7fc153370 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 -- 172.21.15.132:0/1204584647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 msgr2=0x7fe7fc15d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 --2- 172.21.15.132:0/1204584647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc15d170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec009e50 tx=0x7fe7ec02a760 comp rx=0 tx=0).stop 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 -- 172.21.15.132:0/1204584647 shutdown_connections 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 --2- 172.21.15.132:0/1204584647 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc15d170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 -- 172.21.15.132:0/1204584647 >> 172.21.15.132:0/1204584647 conn(0x7fe7fc070970 msgr2=0x7fe7fc070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 -- 172.21.15.132:0/1204584647 shutdown_connections 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.440+0000 7fe800c49640 1 -- 172.21.15.132:0/1204584647 wait complete. 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.441+0000 7fe800c49640 1 Processor -- start 2024-04-25T12:50:19.441 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.441+0000 7fe800c49640 1 -- start start 2024-04-25T12:50:19.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe800c49640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7fc073890 0x7fe7fc1e2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe800c49640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc1508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe800c49640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7fc159000 0x7fe7fc06c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe800c49640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc15c970 con 0x7fe7fc153370 2024-04-25T12:50:19.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe800c49640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7fc15c690 con 0x7fe7fc159000 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe800c49640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7fc15cc50 con 0x7fe7fc073890 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc1508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc1508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55920/0 (socket says 172.21.15.132:55920) 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 -- 172.21.15.132:0/3713323186 learned_addr learned my addr 172.21.15.132:0/3713323186 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 -- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7fc073890 msgr2=0x7fe7fc1e2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7fc073890 0x7fe7fc1e2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7fad9d640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7fc159000 0x7fe7fc06c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 -- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7fc159000 msgr2=0x7fe7fc06c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7fc159000 0x7fe7fc06c820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.442+0000 7fe7f9d9b640 1 -- 172.21.15.132:0/3713323186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7fc1f46c0 con 0x7fe7fc153370 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.443+0000 7fe7f9d9b640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc1508e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c4d0 tx=0x7fe7f000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.443+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0018070 con 0x7fe7fc153370 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.443+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f0007500 con 0x7fe7fc153370 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.443+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7fc1f49a0 con 0x7fe7fc153370 2024-04-25T12:50:19.444 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.443+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f0004a20 con 0x7fe7fc153370 2024-04-25T12:50:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.443+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7fc1f4f60 con 0x7fe7fc153370 2024-04-25T12:50:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.444+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7fc073d50 con 0x7fe7fc153370 2024-04-25T12:50:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.444+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe7f001b070 con 0x7fe7fc153370 2024-04-25T12:50:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.445+0000 7fe7eaffd640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.445+0000 7fe7fa59c640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.445+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7f008b280 con 0x7fe7fc153370 2024-04-25T12:50:19.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.445+0000 7fe7fa59c640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec033000 tx=0x7fe7ec02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.448 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.449+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe7fc073d50 con 0x7fe7fc153370 2024-04-25T12:50:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.658+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7fc0741e0 con 0x7fe7fc153370 2024-04-25T12:50:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.658+0000 7fe7eaffd640 1 -- 172.21.15.132:0/3713323186 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6840 (secure 0 0 0) 0x7fe7f00592e0 con 0x7fe7fc153370 2024-04-25T12:50:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:19.658 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:18.826879+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:50:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2024-04-25T12:50:19.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe7dc06c8f0 msgr2=0x7fe7dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7ec033000 tx=0x7fe7ec02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:19.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 msgr2=0x7fe7fc1508e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc1508e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe7f000c4d0 tx=0x7fe7f000c990 comp rx=0 tx=0).stop 2024-04-25T12:50:19.660 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 shutdown_connections 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe7dc06c8f0 0x7fe7dc06edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe7fc159000 0x7fe7fc06c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7fc153370 0x7fe7fc1508e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 --2- 172.21.15.132:0/3713323186 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7fc073890 0x7fe7fc1e2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.660+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 >> 172.21.15.132:0/3713323186 conn(0x7fe7fc070970 msgr2=0x7fe7fc157d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.661+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 shutdown_connections 2024-04-25T12:50:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.661+0000 7fe800c49640 1 -- 172.21.15.132:0/3713323186 wait complete. 2024-04-25T12:50:19.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:19.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.768+0000 7f93efa43640 1 Processor -- start 2024-04-25T12:50:19.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.768+0000 7f93efa43640 1 -- start start 2024-04-25T12:50:19.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93efa43640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e8151fa0 0x7f93e8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93efa43640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93e8152380 0x7f93e815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93efa43640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e815b500 con 0x7f93e80c4cc0 2024-04-25T12:50:19.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93efa43640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f93e815bae0 con 0x7f93e8152380 2024-04-25T12:50:19.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93efa43640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f93e80c52f0 con 0x7f93e8151fa0 2024-04-25T12:50:19.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93e8152380 0x7f93e815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93e8152380 0x7f93e815bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55924/0 (socket says 172.21.15.132:55924) 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 -- 172.21.15.132:0/4115038095 learned_addr learned my addr 172.21.15.132:0/4115038095 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ed7df640 1 --2- 172.21.15.132:0/4115038095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e8151fa0 0x7f93e8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 -- 172.21.15.132:0/4115038095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e8151fa0 msgr2=0x7f93e8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 --2- 172.21.15.132:0/4115038095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e8151fa0 0x7f93e8157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 -- 172.21.15.132:0/4115038095 >> v1:172.21.15.157:6789/0 conn(0x7f93e80c4cc0 legacy=0x7f93e80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.769+0000 7f93ecfde640 1 -- 172.21.15.132:0/4115038095 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e80c55d0 con 0x7f93e8152380 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.770+0000 7f93ecfde640 1 --2- 172.21.15.132:0/4115038095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e815bf70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009870 tx=0x7f93d802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf17267b15652367 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.770+0000 7f93dffff640 1 -- 172.21.15.132:0/4115038095 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8037070 con 0x7f93e8152380 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.770+0000 7f93dffff640 1 -- 172.21.15.132:0/4115038095 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93d8032440 con 0x7f93e8152380 2024-04-25T12:50:19.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.770+0000 7f93dffff640 1 -- 172.21.15.132:0/4115038095 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93d8032810 con 0x7f93e8152380 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 -- 172.21.15.132:0/4115038095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 msgr2=0x7f93e815bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 --2- 172.21.15.132:0/4115038095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e815bf70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f93d8009870 tx=0x7f93d802a270 comp rx=0 tx=0).stop 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 -- 172.21.15.132:0/4115038095 shutdown_connections 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 --2- 172.21.15.132:0/4115038095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e815bf70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 --2- 172.21.15.132:0/4115038095 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e8151fa0 0x7f93e8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 -- 172.21.15.132:0/4115038095 >> 172.21.15.132:0/4115038095 conn(0x7f93e8067630 msgr2=0x7f93e8067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 -- 172.21.15.132:0/4115038095 shutdown_connections 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.771+0000 7f93efa43640 1 -- 172.21.15.132:0/4115038095 wait complete. 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.772+0000 7f93efa43640 1 Processor -- start 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.772+0000 7f93efa43640 1 -- start start 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e80c4cc0 0x7f93e80ca550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93e8151fa0 0x7f93e814e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e8147e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80c3bc0 con 0x7f93e8152380 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f93e80c58b0 con 0x7f93e8151fa0 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f93e80c9150 con 0x7f93e80c4cc0 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e8147e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e8147e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55932/0 (socket says 172.21.15.132:55932) 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 -- 172.21.15.132:0/2852016113 learned_addr learned my addr 172.21.15.132:0/2852016113 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93ed7df640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e80c4cc0 0x7f93e80ca550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93ecfde640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93e8151fa0 0x7f93e814e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 -- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e80c4cc0 msgr2=0x7f93e80ca550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e80c4cc0 0x7f93e80ca550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 -- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93e8151fa0 msgr2=0x7f93e814e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93e8151fa0 0x7f93e814e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 -- 172.21.15.132:0/2852016113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e814ddd0 con 0x7f93e8152380 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93edfe0640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e8147e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001eb0 tx=0x7f93e000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0017070 con 0x7f93e8152380 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e00052d0 con 0x7f93e8152380 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0003810 con 0x7f93e8152380 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.773+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93e8147970 con 0x7f93e8152380 2024-04-25T12:50:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.774+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93e814c560 con 0x7f93e8152380 2024-04-25T12:50:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.774+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93e80c6b10 con 0x7f93e8152380 2024-04-25T12:50:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.775+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f93e001a070 con 0x7f93e8152380 2024-04-25T12:50:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.775+0000 7f93ddffb640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f93cc06c8f0 0x7f93cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.775+0000 7f93ed7df640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f93cc06c8f0 0x7f93cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.775+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f93e008b0b0 con 0x7f93e8152380 2024-04-25T12:50:19.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.776+0000 7f93ed7df640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f93cc06c8f0 0x7f93cc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93e4003b80 tx=0x7f93e40098d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:19.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.780+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f93e80c6b10 con 0x7f93e8152380 2024-04-25T12:50:19.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.953+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93e814f0b0 con 0x7f93e8152380 2024-04-25T12:50:19.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.954+0000 7f93ddffb640 1 -- 172.21.15.132:0/2852016113 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f93e0058be0 con 0x7f93e8152380 2024-04-25T12:50:19.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:19.954 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f93cc06c8f0 msgr2=0x7f93cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f93cc06c8f0 0x7f93cc06edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f93e4003b80 tx=0x7f93e40098d0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 msgr2=0x7f93e8147e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e8147e20 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f93e0001eb0 tx=0x7f93e000c890 comp rx=0 tx=0).stop 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 shutdown_connections 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f93cc06c8f0 0x7f93cc06edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93e8152380 0x7f93e8147e20 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f93e8151fa0 0x7f93e814e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 --2- 172.21.15.132:0/2852016113 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f93e80c4cc0 0x7f93e80ca550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.956+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 >> 172.21.15.132:0/2852016113 conn(0x7f93e8067630 msgr2=0x7f93e80c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.957+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 shutdown_connections 2024-04-25T12:50:19.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:19.957+0000 7f93efa43640 1 -- 172.21.15.132:0/2852016113 wait complete. 2024-04-25T12:50:20.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:50:12.686402+0000', 'modified': '2024-04-25T12:50:18.826879+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6837/2805783268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 2805783268}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 2805783268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-04-25T12:50:20.570 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T12:50:20.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T12:50:20.669 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.670+0000 7f338bd19640 1 Processor -- start 2024-04-25T12:50:20.670 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.670+0000 7f338bd19640 1 -- start start 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338bd19640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f33840ca200 0x7f338415f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338bd19640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3384070870 0x7f3384070c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338bd19640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33840c8d20 con 0x7f33840c8940 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338bd19640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f33840ca650 con 0x7f3384070870 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338bd19640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f338415b8f0 con 0x7f33840ca200 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3384070870 0x7f3384070c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3384070870 0x7f3384070c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55944/0 (socket says 172.21.15.132:55944) 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 -- 172.21.15.132:0/1196241369 learned_addr learned my addr 172.21.15.132:0/1196241369 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 -- 172.21.15.132:0/1196241369 >> v2:172.21.15.157:3300/0 conn(0x7f33840ca200 msgr2=0x7f338415f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 --2- 172.21.15.132:0/1196241369 >> v2:172.21.15.157:3300/0 conn(0x7f33840ca200 0x7f338415f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.671 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 -- 172.21.15.132:0/1196241369 >> v1:172.21.15.157:6789/0 conn(0x7f33840c8940 legacy=0x7f338415b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:20.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.671+0000 7f338a2b6640 1 -- 172.21.15.132:0/1196241369 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f338415bb50 con 0x7f3384070870 2024-04-25T12:50:20.672 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.672+0000 7f338a2b6640 1 --2- 172.21.15.132:0/1196241369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3384070870 0x7f3384070c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f33840cbe30 tx=0x7f337c02a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d15ca6d8eefbf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.672+0000 7f3388ab3640 1 -- 172.21.15.132:0/1196241369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c037070 con 0x7f3384070870 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.672+0000 7f3388ab3640 1 -- 172.21.15.132:0/1196241369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c032440 con 0x7f3384070870 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.672+0000 7f3388ab3640 1 -- 172.21.15.132:0/1196241369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c032810 con 0x7f3384070870 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 -- 172.21.15.132:0/1196241369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3384070870 msgr2=0x7f3384070c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 --2- 172.21.15.132:0/1196241369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3384070870 0x7f3384070c80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f33840cbe30 tx=0x7f337c02a1c0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 -- 172.21.15.132:0/1196241369 shutdown_connections 2024-04-25T12:50:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 --2- 172.21.15.132:0/1196241369 >> v2:172.21.15.157:3300/0 conn(0x7f33840ca200 0x7f338415f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 --2- 172.21.15.132:0/1196241369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3384070870 0x7f3384070c80 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 -- 172.21.15.132:0/1196241369 >> 172.21.15.132:0/1196241369 conn(0x7f3384067630 msgr2=0x7f3384067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 -- 172.21.15.132:0/1196241369 shutdown_connections 2024-04-25T12:50:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.673+0000 7f338bd19640 1 -- 172.21.15.132:0/1196241369 wait complete. 2024-04-25T12:50:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.674+0000 7f338bd19640 1 Processor -- start 2024-04-25T12:50:20.674 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.674+0000 7f338bd19640 1 -- start start 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3384070870 0x7f33841f1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 0x7f33841ef050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33840ca200 0x7f33840cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f338415e870 con 0x7f33840c8940 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f338415c110 con 0x7f33840ca200 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f338415eb50 con 0x7f3384070870 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 0x7f33841ef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 0x7f33841ef050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55950/0 (socket says 172.21.15.132:55950) 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 -- 172.21.15.132:0/576053959 learned_addr learned my addr 172.21.15.132:0/576053959 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338a2b6640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33840ca200 0x7f33840cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f3389ab5640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3384070870 0x7f33841f1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.677 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 -- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3384070870 msgr2=0x7f33841f1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3384070870 0x7f33841f1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 -- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33840ca200 msgr2=0x7f33840cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33840ca200 0x7f33840cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 -- 172.21.15.132:0/576053959 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33841ef590 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338a2b6640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33840ca200 0x7f33840cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f33892b4640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 0x7f33841ef050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f337400b410 tx=0x7f337400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f337a7fc640 1 -- 172.21.15.132:0/576053959 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374015020 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f337a7fc640 1 -- 172.21.15.132:0/576053959 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374011850 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f337a7fc640 1 -- 172.21.15.132:0/576053959 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374011c40 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f338415e350 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.675+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f338415c800 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.677+0000 7f337a7fc640 1 -- 172.21.15.132:0/576053959 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3374018020 con 0x7f33840c8940 2024-04-25T12:50:20.678 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.677+0000 7f337a7fc640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.677+0000 7f337a7fc640 1 -- 172.21.15.132:0/576053959 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f337408be20 con 0x7f33840c8940 2024-04-25T12:50:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.677+0000 7f3389ab5640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.679 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.678+0000 7f3389ab5640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f336806c8f0 0x7f336806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3380001db0 tx=0x7f3380009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.678+0000 7f338ea2f740 1 Processor -- start 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.678+0000 7f338ea2f740 1 -- start start 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173a690 0x55c88177ea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 0x55c88173df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c8817888a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338ea2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c8816a3c50 con 0x55c881739fc0 2024-04-25T12:50:20.684 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55c881640830 con 0x55c88173aa70 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55c88169fc10 con 0x55c88173a690 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 0x55c88173df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 0x55c88173df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55952/0 (socket says 172.21.15.132:55952) 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 -- 172.21.15.132:0/2123236807 learned_addr learned my addr 172.21.15.132:0/2123236807 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f338a2b6640 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c8817888a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 -- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173a690 msgr2=0x55c88177ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173a690 0x55c88177ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 -- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 msgr2=0x55c8817888a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c8817888a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 -- 172.21.15.132:0/2123236807 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c8813b62d0 con 0x55c881739fc0 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.679+0000 7f33892b4640 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 0x55c88173df40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3374089fb0 tx=0x7f3374059fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c180dfece29e44 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f33677fe640 1 -- 172.21.15.132:0/2123236807 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374057820 con 0x55c881739fc0 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f33677fe640 1 -- 172.21.15.132:0/2123236807 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374088070 con 0x55c881739fc0 2024-04-25T12:50:20.685 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f33677fe640 1 -- 172.21.15.132:0/2123236807 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3374055df0 con 0x55c881739fc0 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 -- 172.21.15.132:0/2123236807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 msgr2=0x55c88173df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 0x55c88173df40 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3374089fb0 tx=0x7f3374059fb0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 -- 172.21.15.132:0/2123236807 shutdown_connections 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c8817888a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881739fc0 0x55c88173df40 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2123236807 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173a690 0x55c88177ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 -- 172.21.15.132:0/2123236807 >> 172.21.15.132:0/2123236807 conn(0x55c88173bc80 msgr2=0x55c88173e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 -- 172.21.15.132:0/2123236807 shutdown_connections 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.680+0000 7f338ea2f740 1 -- 172.21.15.132:0/2123236807 wait complete. 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.681+0000 7f338ea2f740 1 -- start start 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.681+0000 7f338ea2f740 1 Processor -- start 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 0x55c88177fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c881767170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.686 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c881780d70 0x55c881793820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c88177f700 con 0x55c88173a690 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55c88163e470 con 0x55c88173aa70 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55c88173d0e0 con 0x55c881780d70 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 10 client.0 _ll_register_callbacks cb 0x55c881663f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 0x55c88177fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 0x55c88177fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55962/0 (socket says 172.21.15.132:55962) 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 -- 172.21.15.132:0/773848584 learned_addr learned my addr 172.21.15.132:0/773848584 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f33892b4640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c881767170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338a2b6640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c881780d70 0x55c881793820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 -- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c881780d70 msgr2=0x55c881793820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c881780d70 0x55c881793820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 -- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 msgr2=0x55c881767170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c881767170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:20.687 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 -- 172.21.15.132:0/773848584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c8814806b0 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3389ab5640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 0x55c88177fc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f338000e990 tx=0x7f338000ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31269b27768ec5a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3364ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3364ff9640 1 -- 172.21.15.132:0/773848584 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33800057e0 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f3364ff9640 1 -- 172.21.15.132:0/773848584 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3380013420 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.682+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3374088070 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f3364ff9640 1 -- 172.21.15.132:0/773848584 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f3380013620 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 10 client.4440 fetch_fsmap learned FSMap version 6 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55c881780720 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f3364ff9640 1 -- 172.21.15.132:0/773848584 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3374088070 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f3364ff9640 1 -- 172.21.15.132:0/773848584 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f338002a050 con 0x55c88173a690 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 10 client.4440 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 10 client.4440 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:50:20.688 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 20 client.4440 populate_metadata read hostname 'smithi132' 2024-04-25T12:50:20.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c88179b050 0x55c88179f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:20.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 4 client.4440 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:50:20.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 --> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c8816b1670 con 0x55c88179b050 2024-04-25T12:50:20.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f33892b4640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c88179b050 0x55c88179f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:20.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f3364ff9640 10 client.4440 ms_handle_connect on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:20.689 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:20.683+0000 7f33892b4640 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c88179b050 0x55c88179f3e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc9fa806d9258968 server_cookie=14c1faa3c354b65a in_seq=0 out_seq=0 2024-04-25T12:50:23.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f3364ff9640 1 -- 172.21.15.132:0/773848584 <== mds.0 v2:172.21.15.157:6836/2805783268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55c8816b1670 con 0x55c88179b050 2024-04-25T12:50:23.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f3364ff9640 10 client.4440 handle_command_reply: tid=0 2024-04-25T12:50:23.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 client.4440 shutdown 2024-04-25T12:50:23.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 msgr2=0x55c88177fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 0x55c88177fc80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f338000e990 tx=0x7f338000ed90 comp rx=0 tx=0).stop 2024-04-25T12:50:23.828 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 shutdown_connections 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c88179b050 0x55c88179f3e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c881780d70 0x55c881793820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173aa70 0x55c881767170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 --2- 172.21.15.132:0/773848584 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c88173a690 0x55c88177fc80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 >> 172.21.15.132:0/773848584 conn(0x55c881739fc0 msgr2=0x55c88177d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.829+0000 7f3364ff9640 0 client.4440 ms_handle_reset on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.830+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 shutdown_connections 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.830+0000 7f338ea2f740 1 -- 172.21.15.132:0/773848584 wait complete. 2024-04-25T12:50:23.829 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.830+0000 7f338ea2f740 20 client.4440 trim_cache size 0 max 16384 2024-04-25T12:50:23.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 Processor -- start 2024-04-25T12:50:23.847 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 -- start start 2024-04-25T12:50:23.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c88175a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817665d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881766b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f33841fdc80 con 0x55c881780d70 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55c8817678e0 con 0x55c88173a690 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.849+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55c881789680 con 0x55c88173aa70 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881766b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881766b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35710/0 (socket says 172.21.15.132:35710) 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 -- 172.21.15.132:0/235918912 learned_addr learned my addr 172.21.15.132:0/235918912 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f3389ab5640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c88175a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f33892b4640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817665d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 -- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 msgr2=0x55c8817665d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817665d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 -- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 msgr2=0x55c88175a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c88175a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 -- 172.21.15.132:0/235918912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c88177e5e0 con 0x55c881780d70 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f3389ab5640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c88175a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f33892b4640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f338a2b6640 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881766b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f337c0097f0 tx=0x7f337c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81c8c9ac433fa063 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f3366ffd640 1 -- 172.21.15.132:0/235918912 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c04b070 con 0x55c881780d70 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f3366ffd640 1 -- 172.21.15.132:0/235918912 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c032580 con 0x55c881780d70 2024-04-25T12:50:23.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.850+0000 7f3366ffd640 1 -- 172.21.15.132:0/235918912 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c037040 con 0x55c881780d70 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 -- 172.21.15.132:0/235918912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 msgr2=0x55c881766b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881766b10 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f337c0097f0 tx=0x7f337c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 -- 172.21.15.132:0/235918912 shutdown_connections 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881766b10 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817665d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 --2- 172.21.15.132:0/235918912 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c88175a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 -- 172.21.15.132:0/235918912 >> 172.21.15.132:0/235918912 conn(0x55c881739fc0 msgr2=0x55c88177d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 -- 172.21.15.132:0/235918912 shutdown_connections 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.851+0000 7f338ea2f740 1 -- 172.21.15.132:0/235918912 wait complete. 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.852+0000 7f338ea2f740 1 -- start start 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.852+0000 7f338ea2f740 1 Processor -- start 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c881764830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817a4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881789fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x55c88179aed0 con 0x55c881780d70 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x55c8817945e0 con 0x55c88173a690 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x55c88179b520 con 0x55c88173aa70 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338ea2f740 10 client.0 _ll_register_callbacks cb 0x7f33800019a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881789fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f3389ab5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c881764830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881789fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35726/0 (socket says 172.21.15.132:35726) 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 -- 172.21.15.132:0/2104597885 learned_addr learned my addr 172.21.15.132:0/2104597885 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f33892b4640 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817a4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 -- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 msgr2=0x55c8817a4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817a4d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 -- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 msgr2=0x55c881764830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c881764830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.853+0000 7f338a2b6640 1 -- 172.21.15.132:0/2104597885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c88178a510 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338a2b6640 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881789fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f337c049040 tx=0x7f337c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e924e371c5109497 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f3364ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f3364ff9640 1 -- 172.21.15.132:0/2104597885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f337c053060 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f3364ff9640 1 -- 172.21.15.132:0/2104597885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f337c046410 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f337c032580 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f3364ff9640 1 -- 172.21.15.132:0/2104597885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f337c04b070 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 10 client.4446 fetch_fsmap learned FSMap version 6 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55c881766dc0 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f3364ff9640 1 -- 172.21.15.132:0/2104597885 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337c032580 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f3364ff9640 1 -- 172.21.15.132:0/2104597885 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f337c054260 con 0x55c881780d70 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 10 client.4446 fetch_fsmap finished waiting for FSMap version 6 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 10 client.4446 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:50:23.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 20 client.4446 populate_metadata read hostname 'smithi132' 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c8817fea10 0x55c8817fedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 4 client.4446 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.854+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 --> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] -- command(tid 0: {"prefix": "status"}) -- 0x55c8816ab4e0 con 0x55c8817fea10 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f3389ab5640 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c8817fea10 0x55c8817fedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f3389ab5640 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c8817fea10 0x55c8817fedf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1ffc861b77c840b server_cookie=581ac0c528622a90 in_seq=0 out_seq=0 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f3364ff9640 10 client.4446 ms_handle_connect on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f3364ff9640 1 -- 172.21.15.132:0/2104597885 <== mds.0 v2:172.21.15.157:6836/2805783268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55c8816ab4e0 con 0x55c8817fea10 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f3364ff9640 10 client.4446 handle_command_reply: tid=0 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 client.4446 shutdown 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 msgr2=0x55c881789fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881789fd0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f337c049040 tx=0x7f337c004730 comp rx=0 tx=0).stop 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 shutdown_connections 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x55c8817fea10 0x55c8817fedf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55c881780d70 0x55c881789fd0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x55c88173aa70 0x55c8817a4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f3364ff9640 0 client.4446 ms_handle_reset on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 --2- 172.21.15.132:0/2104597885 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x55c88173a690 0x55c881764830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.855+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 >> 172.21.15.132:0/2104597885 conn(0x55c881739fc0 msgr2=0x55c88173ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 shutdown_connections 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338ea2f740 1 -- 172.21.15.132:0/2104597885 wait complete. 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338ea2f740 20 client.4446 trim_cache size 0 max 16384 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "5bda364d-1418-47e5-9931-4f49e5bffd9b", 2024-04-25T12:50:23.859 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4296, 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 10.504390465, 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 6, 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 25, 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 17.098092645000001 2024-04-25T12:50:23.860 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:50:23.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f336806c8f0 msgr2=0x7f336806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f336806c8f0 0x7f336806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3380001db0 tx=0x7f3380009040 comp rx=0 tx=0).stop 2024-04-25T12:50:23.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 msgr2=0x7f33841ef050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 0x7f33841ef050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f337400b410 tx=0x7f337400b8d0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 shutdown_connections 2024-04-25T12:50:23.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f336806c8f0 0x7f336806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33840ca200 0x7f33840cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33840c8940 0x7f33841ef050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 --2- 172.21.15.132:0/576053959 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3384070870 0x7f33841f1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 >> 172.21.15.132:0/576053959 conn(0x7f3384067630 msgr2=0x7f33840c7a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:23.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 shutdown_connections 2024-04-25T12:50:23.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.856+0000 7f338bd19640 1 -- 172.21.15.132:0/576053959 wait complete. 2024-04-25T12:50:23.868 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T12:50:23.868 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:23.868 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T12:50:23.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.972+0000 7f7bc6f20640 1 Processor -- start 2024-04-25T12:50:23.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.972+0000 7f7bc6f20640 1 -- start start 2024-04-25T12:50:23.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc6f20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc0151fa0 0x7f7bc0157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc6f20640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7bc00c4cc0 0x7f7bc015bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc6f20640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7bc015b500 con 0x7f7bc0152380 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc6f20640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7bc015bae0 con 0x7f7bc00c4cc0 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc6f20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc00c52f0 con 0x7f7bc0151fa0 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bbffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7bc0152380 0x7f7bc00c8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59974/0 (socket says 172.21.15.132:59974) 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bbffff640 1 -- 172.21.15.132:0/1307089046 learned_addr learned my addr 172.21.15.132:0/1307089046 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc54bd640 1 --2- 172.21.15.132:0/1307089046 >> v2:172.21.15.157:3300/0 conn(0x7f7bc00c4cc0 0x7f7bc015bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc0151fa0 0x7f7bc0157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3128477104 0 0) 0x7f7bc015b500 con 0x7f7bc0152380 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.973+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ba8003520 con 0x7f7bc0152380 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2688526898 0 0) 0x7f7ba8003520 con 0x7f7bc0152380 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc0151fa0 msgr2=0x7f7bc0157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc0151fa0 0x7f7bc0157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 >> v2:172.21.15.157:3300/0 conn(0x7f7bc00c4cc0 msgr2=0x7f7bc015bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 --2- 172.21.15.132:0/1307089046 >> v2:172.21.15.157:3300/0 conn(0x7f7bc00c4cc0 0x7f7bc015bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc00c55d0 con 0x7f7bc0152380 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f7bb4001670 con 0x7f7bc0152380 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 >> v1:172.21.15.132:6789/0 conn(0x7f7bc0152380 legacy=0x7f7bc00c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ba80039b0 0x7f7ba8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7ba8004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8004ef0 0x7f7ba800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc015bae0 con 0x7f7ba80043a0 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc00c52f0 con 0x7f7ba8004ef0 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ba800bf00 con 0x7f7ba80039b0 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bc54bd640 1 --2- 172.21.15.132:0/1307089046 >> v2:172.21.15.157:3300/0 conn(0x7f7bc00c4cc0 0x7f7bc015bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:23.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc0151fa0 0x7f7bc0157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbffff640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7ba8004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ba80039b0 0x7f7ba8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bc54bd640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8004ef0 0x7f7ba800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbffff640 1 -- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ba80039b0 msgr2=0x7f7ba8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbffff640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ba80039b0 0x7f7ba8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbffff640 1 -- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8004ef0 msgr2=0x7f7ba800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbffff640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ba8004ef0 0x7f7ba800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bbffff640 1 -- 172.21.15.132:0/1307089046 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba8003520 con 0x7f7ba80043a0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.974+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ba80039b0 0x7f7ba8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bbffff640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7ba8004880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c240 tx=0x7f7ba8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ef8a27b8f068865 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb402e070 con 0x7f7ba80043a0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb4005af0 con 0x7f7ba80043a0 2024-04-25T12:50:23.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bbf7fe640 1 -- 172.21.15.132:0/1307089046 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4007d30 con 0x7f7ba80043a0 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc6f20640 1 -- 172.21.15.132:0/1307089046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 msgr2=0x7f7ba8004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/1307089046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7ba8004880 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f7bb400c240 tx=0x7f7ba8005830 comp rx=0 tx=0).stop 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc54bd640 1 -- 172.21.15.132:0/1307089046 reap_dead start 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc6f20640 1 -- 172.21.15.132:0/1307089046 shutdown_connections 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc6f20640 1 -- 172.21.15.132:0/1307089046 >> 172.21.15.132:0/1307089046 conn(0x7f7bc0067630 msgr2=0x7f7bc0067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc6f20640 1 -- 172.21.15.132:0/1307089046 shutdown_connections 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.975+0000 7f7bc6f20640 1 -- 172.21.15.132:0/1307089046 wait complete. 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.976+0000 7f7bc6f20640 1 Processor -- start 2024-04-25T12:50:23.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 -- start start 2024-04-25T12:50:23.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7bc0150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc01566c0 0x7f7bc013f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc013f9d0 0x7f7bc013e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc00c3bc0 con 0x7f7ba80043a0 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7bc00c58b0 con 0x7f7bc013f9d0 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc6f20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7bc0157e70 con 0x7f7bc01566c0 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.977+0000 7f7bc4cbc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7bc0150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7bc0150910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35738/0 (socket says 172.21.15.132:35738) 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 -- 172.21.15.132:0/920776708 learned_addr learned my addr 172.21.15.132:0/920776708 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bbffff640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc01566c0 0x7f7bc013f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc54bd640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc013f9d0 0x7f7bc013e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 -- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc01566c0 msgr2=0x7f7bc013f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc01566c0 0x7f7bc013f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 -- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc013f9d0 msgr2=0x7f7bc013e1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc013f9d0 0x7f7bc013e1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 -- 172.21.15.132:0/920776708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bc01f1000 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc4cbc640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7bc0150910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00116d0 tx=0x7f7bb0011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb000f9c0 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7bb000fb60 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0015460 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bc01f12a0 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.978+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bc01f1860 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.979+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bc0068c20 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.980+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7bb0015600 con 0x7f7ba80043a0 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.980+0000 7f7bbd7fa640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7bac06c920 0x7f7bac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:23.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.980+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7bb008c880 con 0x7f7ba80043a0 2024-04-25T12:50:23.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.980+0000 7f7bbffff640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7bac06c920 0x7f7bac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:23.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.980+0000 7f7bbffff640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7bac06c920 0x7f7bac06ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4033000 tx=0x7f7bb4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:23.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:23.984+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7bb0019030 con 0x7f7ba80043a0 2024-04-25T12:50:24.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.197+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7bc013de10 con 0x7f7ba80043a0 2024-04-25T12:50:24.195 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.197+0000 7f7bbd7fa640 1 -- 172.21.15.132:0/920776708 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f7bb005a970 con 0x7f7ba80043a0 2024-04-25T12:50:24.195 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7bac06c920 msgr2=0x7f7bac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7bac06c920 0x7f7bac06ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4033000 tx=0x7f7bb4009030 comp rx=0 tx=0).stop 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 msgr2=0x7f7bc0150910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7bc0150910 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7bb00116d0 tx=0x7f7bb0011b90 comp rx=0 tx=0).stop 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 shutdown_connections 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7bac06c920 0x7f7bac06ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7bc013f9d0 0x7f7bc013e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7bc01566c0 0x7f7bc013f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 --2- 172.21.15.132:0/920776708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ba80043a0 0x7f7bc0150910 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 >> 172.21.15.132:0/920776708 conn(0x7f7bc0067630 msgr2=0x7f7bc006ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:24.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 shutdown_connections 2024-04-25T12:50:24.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24.199+0000 7f7bc6f20640 1 -- 172.21.15.132:0/920776708 wait complete. 2024-04-25T12:50:24.208 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-25T12:50:24.208 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T12:50:24.208 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-04-25T12:50:24.209 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-25T12:50:24.209 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:24.209 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-25T12:50:24.209 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T12:50:24.209 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T12:50:24.209 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T12:50:24.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:24.209 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-04-25T12:50:24.224 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T12:50:24.224 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T12:50:24.224 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T12:50:24.224 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:24.225 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T12:50:24.226 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42680sec preferred_lft 42680sec 2024-04-25T12:50:24.226 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::d0a2:2792:ed08:58a3/64 scope link noprefixroute 2024-04-25T12:50:24.226 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:50:24.226 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T12:50:24.226 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:24.227 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:24.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2024-04-25T12:50:24.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2024-04-25T12:50:24.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2024-04-25T12:50:24.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T12:50:24.227 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:24.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:24.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:24.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:24.408 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T12:50:24.431 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-04-25T12:50:24.432 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:24.433 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-04-25T12:50:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-04-25T12:50:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T12:50:24.498 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T12:50:24.499 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T12:50:24.499 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T12:50:24.499 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:24.499 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:24.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T12:50:24.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T12:50:24.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T12:50:24.499 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:24.587 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:24.801 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:24.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:24.807 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-25T12:50:24.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:24.823 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2024-04-25T12:50:24.879 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:24.879 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:24.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:24.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-25T12:50:24.879 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:24.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:24.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:24.996 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-25T12:50:24.997 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:25.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:25.120 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:25.126 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:25.126 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:25.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2024-04-25T12:50:25.127 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T12:50:25.127 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:25.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:25.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:25.202 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-25T12:50:25.202 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:50:25.202 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:25.217 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-25T12:50:25.218 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:50:25.218 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:25.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-25T12:50:25.339 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:50:25.395 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-25T12:50:25.396 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:50:25.397 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:50:25.398 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-25T12:50:25.398 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:25.398 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:25.398 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:25.399 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-25T12:50:25.454 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T12:50:25.455 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-25T12:50:25.498 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-25T12:50:25.521 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-25T12:50:25.576 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-25T12:50:25.577 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:25.578 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:25.578 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-25T12:50:25.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:2024-04-25T12:50:25.589+0000 7f9246a2d480 -1 init, newargv = 0x5565603c4850 newargc=15 2024-04-25T12:50:25.587 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:ceph-fuse[41911]: starting ceph client 2024-04-25T12:50:25.795 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:ceph-fuse[41911]: starting fuse 2024-04-25T12:50:26.702 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2024-04-25T12:50:26.730 DEBUG:teuthology.orchestra.run.smithi132:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T12:50:26.786 INFO:teuthology.orchestra.run.smithi132.stdout:/proc 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/sys 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/dev 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/security 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/shm 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/pts 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/run 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/cgroup 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/pstore 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/bpf 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/ 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/selinux 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T12:50:26.787 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/mqueue 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/hugepages 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/debug 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/tracing 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/kernel/config 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysusers.service 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/sys/fs/fuse/connections 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-sysctl.service 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/run/user/1000 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-0 2024-04-25T12:50:26.788 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-1 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-2 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run.smithi132.stdout:/var/lib/ceph/osd/ceph-3 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run.smithi132.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run.smithi132.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:26.789 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:26.789 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2024-04-25T12:50:26.842 INFO:teuthology.orchestra.run.smithi132.stdout:43 2024-04-25T12:50:26.843 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo stdin-killer -- python3 -c ' 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> import re 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> import os 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-25T12:50:26.843 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> return f 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.admin")) 2024-04-25T12:50:26.844 DEBUG:teuthology.orchestra.run.smithi132:> ' 2024-04-25T12:50:26.961 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.admin.41911.asok 2024-04-25T12:50:26.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:26.971 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.41911.asok 2024-04-25T12:50:26.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:26.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.41911.asok status 2024-04-25T12:50:27.103 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:50:27.103 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2024-04-25T12:50:27.103 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-25T12:50:27.103 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "admin", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "41911", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4458, 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4458 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2024-04-25T12:50:27.104 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 632981594 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: } 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 632981594 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4458 192.168.0.1:0/632981594", 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/632981594", 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 6, 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 25, 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2024-04-25T12:50:27.105 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2024-04-25T12:50:27.106 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2024-04-25T12:50:27.106 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:50:27.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:27.112 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2024-04-25T12:50:27.112 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:27.127 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2024-04-25T12:50:27.127 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:27.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:27.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:27.193 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-25T12:50:27.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T12:50:27.694 INFO:teuthology.orchestra.run.smithi132.stdout:# file: . 2024-04-25T12:50:27.695 INFO:teuthology.orchestra.run.smithi132.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-25T12:50:27.695 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:27.695 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:27.701 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:50:27.701 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:50:27.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:27.748 INFO:tasks.ceph.mds.f.smithi157.stderr:2024-04-25T12:50:27.750+0000 7f02f5e9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T12:50:27.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.854+0000 7fa2fc89a640 1 Processor -- start 2024-04-25T12:50:27.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.854+0000 7fa2fc89a640 1 -- start start 2024-04-25T12:50:27.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2fc89a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2f8151fa0 0x7fa2f8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:27.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2fc89a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f8152380 0x7fa2f815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:27.853 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2fc89a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f815b500 con 0x7fa2f80c4cc0 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2fc89a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa2f815bae0 con 0x7fa2f8151fa0 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2fc89a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f80c52f0 con 0x7fa2f8152380 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2f8151fa0 0x7fa2f8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa2f80c4cc0 0x7fa2f80c8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59988/0 (socket says 172.21.15.132:59988) 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2f8151fa0 0x7fa2f8157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35740/0 (socket says 172.21.15.132:35740) 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f6d9d640 1 -- 172.21.15.132:0/4235630202 learned_addr learned my addr 172.21.15.132:0/4235630202 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f659c640 1 -- 172.21.15.132:0/4235630202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f8152380 msgr2=0x7fa2f815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f659c640 1 --2- 172.21.15.132:0/4235630202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f8152380 0x7fa2f815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f659c640 1 -- 172.21.15.132:0/4235630202 >> v1:172.21.15.132:6789/0 conn(0x7fa2f80c4cc0 legacy=0x7fa2f80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f5d9b640 1 -- 172.21.15.132:0/4235630202 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3605104825 0 0) 0x7fa2f815b500 con 0x7fa2f80c4cc0 2024-04-25T12:50:27.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.855+0000 7fa2f659c640 1 -- 172.21.15.132:0/4235630202 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f80c55d0 con 0x7fa2f8151fa0 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.856+0000 7fa2f659c640 1 --2- 172.21.15.132:0/4235630202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f8157e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80097a0 tx=0x7fa2e802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a55e57ca9434b6da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.856+0000 7fa2f5d9b640 1 -- 172.21.15.132:0/4235630202 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8037070 con 0x7fa2f8151fa0 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.856+0000 7fa2f5d9b640 1 -- 172.21.15.132:0/4235630202 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e8032440 con 0x7fa2f8151fa0 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.856+0000 7fa2f5d9b640 1 -- 172.21.15.132:0/4235630202 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8032810 con 0x7fa2f8151fa0 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 -- 172.21.15.132:0/4235630202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 msgr2=0x7fa2f8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/4235630202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f8157e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80097a0 tx=0x7fa2e802a180 comp rx=0 tx=0).stop 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 -- 172.21.15.132:0/4235630202 shutdown_connections 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/4235630202 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f8152380 0x7fa2f815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/4235630202 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f8157e70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 -- 172.21.15.132:0/4235630202 >> 172.21.15.132:0/4235630202 conn(0x7fa2f8067630 msgr2=0x7fa2f8067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 -- 172.21.15.132:0/4235630202 shutdown_connections 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.857+0000 7fa2fc89a640 1 -- 172.21.15.132:0/4235630202 wait complete. 2024-04-25T12:50:27.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.858+0000 7fa2fc89a640 1 Processor -- start 2024-04-25T12:50:27.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.858+0000 7fa2fc89a640 1 -- start start 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f80c4cc0 0x7fa2f8148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f806e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2f8152380 0x7fa2f814e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80c3bc0 con 0x7fa2f8151fa0 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa2f80c58b0 con 0x7fa2f8152380 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa2f80c9150 con 0x7fa2f80c4cc0 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f806e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f806e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35756/0 (socket says 172.21.15.132:35756) 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 -- 172.21.15.132:0/2463472641 learned_addr learned my addr 172.21.15.132:0/2463472641 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2f659c640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f80c4cc0 0x7fa2f8148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2f6d9d640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2f8152380 0x7fa2f814e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 -- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f80c4cc0 msgr2=0x7fa2f8148950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:27.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f80c4cc0 0x7fa2f8148950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 -- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2f8152380 msgr2=0x7fa2f814e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2f8152380 0x7fa2f814e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 -- 172.21.15.132:0/2463472641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f814a750 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2effff640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f806e6e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000b440 tx=0x7fa2e000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0015020 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2e0011890 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f81e1ea0 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e0011c80 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.859+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2f81e2460 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.860+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2f8068c20 con 0x7fa2f8151fa0 2024-04-25T12:50:27.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.861+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa2e0018020 con 0x7fa2f8151fa0 2024-04-25T12:50:27.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.861+0000 7fa2eeffd640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa2d806c8f0 0x7fa2d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:27.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.861+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa2e008bdc0 con 0x7fa2f8151fa0 2024-04-25T12:50:27.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.861+0000 7fa2f659c640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa2d806c8f0 0x7fa2d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:27.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.862+0000 7fa2f659c640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa2d806c8f0 0x7fa2d806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8034000 tx=0x7fa2e802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:27.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:27.866+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa2e001f020 con 0x7fa2f8151fa0 2024-04-25T12:50:28.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.040+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2f8067b40 con 0x7fa2f8151fa0 2024-04-25T12:50:28.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.041+0000 7fa2eeffd640 1 -- 172.21.15.132:0/2463472641 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7fa2e000d040 con 0x7fa2f8151fa0 2024-04-25T12:50:28.039 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:28.039 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:28.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa2d806c8f0 msgr2=0x7fa2d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa2d806c8f0 0x7fa2d806edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8034000 tx=0x7fa2e802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 msgr2=0x7fa2f806e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f806e6e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa2e000b440 tx=0x7fa2e000b900 comp rx=0 tx=0).stop 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 shutdown_connections 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa2d806c8f0 0x7fa2d806edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa2f8152380 0x7fa2f814e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2f8151fa0 0x7fa2f806e6e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 --2- 172.21.15.132:0/2463472641 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2f80c4cc0 0x7fa2f8148950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 >> 172.21.15.132:0/2463472641 conn(0x7fa2f8067630 msgr2=0x7fa2f8155dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 shutdown_connections 2024-04-25T12:50:28.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.043+0000 7fa2fc89a640 1 -- 172.21.15.132:0/2463472641 wait complete. 2024-04-25T12:50:28.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:50:11.154024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:50:11.639000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:50:15.365379+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:50:28.053 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.154+0000 7fd370c6b640 1 Processor -- start 2024-04-25T12:50:28.152 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.154+0000 7fd370c6b640 1 -- start start 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd370c6b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd36c0c7250 0x7fd36c06b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd370c6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c15b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd370c6b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36c15bca0 con 0x7fd36c15b810 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd370c6b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd36c0c8920 con 0x7fd36c0c7250 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd370c6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c140630 con 0x7fd36c06be70 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd36a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd36c0c7250 0x7fd36c06b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd36ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd36c15b810 0x7fd36c0c7c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59990/0 (socket says 172.21.15.132:59990) 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd36ad9d640 1 -- 172.21.15.132:0/4107605829 learned_addr learned my addr 172.21.15.132:0/4107605829 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.155+0000 7fd369d9b640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c15b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36a59c640 1 -- 172.21.15.132:0/4107605829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 msgr2=0x7fd36c15b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:28.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36a59c640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c15b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36a59c640 1 -- 172.21.15.132:0/4107605829 >> v1:172.21.15.132:6789/0 conn(0x7fd36c15b810 legacy=0x7fd36c0c7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36a59c640 1 -- 172.21.15.132:0/4107605829 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c140910 con 0x7fd36c0c7250 2024-04-25T12:50:28.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36959a640 1 -- 172.21.15.132:0/4107605829 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 206590260 0 0) 0x7fd36c15bca0 con 0x7fd36c15b810 2024-04-25T12:50:28.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd369d9b640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36a59c640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c06b930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009d90 tx=0x7fd35c02a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aba08218c13d28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36959a640 1 -- 172.21.15.132:0/4107605829 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c007740 con 0x7fd36c0c7250 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36959a640 1 -- 172.21.15.132:0/4107605829 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd35c0078e0 con 0x7fd36c0c7250 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.156+0000 7fd36959a640 1 -- 172.21.15.132:0/4107605829 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd35c007cb0 con 0x7fd36c0c7250 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 -- 172.21.15.132:0/4107605829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 msgr2=0x7fd36c06b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c06b930 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd35c009d90 tx=0x7fd35c02a6f0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 -- 172.21.15.132:0/4107605829 shutdown_connections 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c15b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 --2- 172.21.15.132:0/4107605829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c06b930 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 -- 172.21.15.132:0/4107605829 >> 172.21.15.132:0/4107605829 conn(0x7fd36c067a50 msgr2=0x7fd36c06d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 -- 172.21.15.132:0/4107605829 shutdown_connections 2024-04-25T12:50:28.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.157+0000 7fd370c6b640 1 -- 172.21.15.132:0/4107605829 wait complete. 2024-04-25T12:50:28.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.158+0000 7fd370c6b640 1 Processor -- start 2024-04-25T12:50:28.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.158+0000 7fd370c6b640 1 -- start start 2024-04-25T12:50:28.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd370c6b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c159790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd370c6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c1f32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd370c6b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd36c15b810 0x7fd36c1f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd370c6b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c0c7630 con 0x7fd36c0c7250 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd370c6b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd36c140ed0 con 0x7fd36c15b810 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd370c6b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd36c0717c0 con 0x7fd36c06be70 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c1f32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c1f32e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35776/0 (socket says 172.21.15.132:35776) 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 -- 172.21.15.132:0/726084902 learned_addr learned my addr 172.21.15.132:0/726084902 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd36ad9d640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd36c15b810 0x7fd36c1f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd36a59c640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 -- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 msgr2=0x7fd36c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 -- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd36c15b810 msgr2=0x7fd36c1f3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd36c15b810 0x7fd36c1f3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd369d9b640 1 -- 172.21.15.132:0/726084902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd36c13d3e0 con 0x7fd36c0c7250 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd36ad9d640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd36c15b810 0x7fd36c1f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.159+0000 7fd36a59c640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:28.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.160+0000 7fd369d9b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c1f32e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d7d0 tx=0x7fd36000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.160+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd360004030 con 0x7fd36c0c7250 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.160+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3600041d0 con 0x7fd36c0c7250 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.160+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd36000b6c0 con 0x7fd36c0c7250 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.160+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd36c13d6c0 con 0x7fd36c0c7250 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.160+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd36c1f2ae0 con 0x7fd36c0c7250 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.161+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd36c1f25f0 con 0x7fd36c0c7250 2024-04-25T12:50:28.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.161+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd36000b860 con 0x7fd36c0c7250 2024-04-25T12:50:28.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.162+0000 7fd35affd640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd34c06c8f0 0x7fd34c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.162+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd36008c240 con 0x7fd36c0c7250 2024-04-25T12:50:28.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.162+0000 7fd36a59c640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd34c06c8f0 0x7fd34c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.162+0000 7fd36a59c640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd34c06c8f0 0x7fd34c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd35c034000 tx=0x7fd35c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.166+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd36005a2a0 con 0x7fd36c0c7250 2024-04-25T12:50:28.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.339+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd36c0741e0 con 0x7fd36c0c7250 2024-04-25T12:50:28.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.339+0000 7fd35affd640 1 -- 172.21.15.132:0/726084902 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7fd360059ba0 con 0x7fd36c0c7250 2024-04-25T12:50:28.338 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd34c06c8f0 msgr2=0x7fd34c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd34c06c8f0 0x7fd34c06edb0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd35c034000 tx=0x7fd35c02f000 comp rx=0 tx=0).stop 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 msgr2=0x7fd36c1f32e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c1f32e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd36000d7d0 tx=0x7fd36000dc90 comp rx=0 tx=0).stop 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 shutdown_connections 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd34c06c8f0 0x7fd34c06edb0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd36c15b810 0x7fd36c1f3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd36c0c7250 0x7fd36c1f32e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 --2- 172.21.15.132:0/726084902 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd36c06be70 0x7fd36c159790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 >> 172.21.15.132:0/726084902 conn(0x7fd36c067a50 msgr2=0x7fd36c0c60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 shutdown_connections 2024-04-25T12:50:28.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.341+0000 7fd370c6b640 1 -- 172.21.15.132:0/726084902 wait complete. 2024-04-25T12:50:28.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:50:28.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.452+0000 7f5fd5d08640 1 Processor -- start 2024-04-25T12:50:28.450 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.452+0000 7f5fd5d08640 1 -- start start 2024-04-25T12:50:28.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fd5d08640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5fd00cdfe0 0x7f5fd015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fd5d08640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f5fd015ed00 0x7f5fd00cb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fd5d08640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd00cbef0 con 0x7f5fd0155380 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fd5d08640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd015f130 con 0x7f5fd00cdfe0 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fd5d08640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd00d08a0 con 0x7f5fd015ed00 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5fd00cdfe0 0x7f5fd015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5fd00cdfe0 0x7f5fd015e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35790/0 (socket says 172.21.15.132:35790) 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 -- 172.21.15.132:0/3176433093 learned_addr learned my addr 172.21.15.132:0/3176433093 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fcffff640 1 --2- 172.21.15.132:0/3176433093 >> v2:172.21.15.157:3300/0 conn(0x7f5fd015ed00 0x7f5fd00cb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 -- 172.21.15.132:0/3176433093 >> v2:172.21.15.157:3300/0 conn(0x7f5fd015ed00 msgr2=0x7f5fd00cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 --2- 172.21.15.132:0/3176433093 >> v2:172.21.15.157:3300/0 conn(0x7f5fd015ed00 0x7f5fd00cb2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 -- 172.21.15.132:0/3176433093 >> v1:172.21.15.157:6789/0 conn(0x7f5fd0155380 legacy=0x7f5fd00c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.453+0000 7f5fceffd640 1 -- 172.21.15.132:0/3176433093 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd00d0af0 con 0x7f5fd00cdfe0 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.454+0000 7f5fceffd640 1 --2- 172.21.15.132:0/3176433093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd00cdfe0 0x7f5fd015e7c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00ce430 tx=0x7f5fc402a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6baf3067c7c97b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.454+0000 7f5fce7fc640 1 -- 172.21.15.132:0/3176433093 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037070 con 0x7f5fd00cdfe0 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.454+0000 7f5fce7fc640 1 -- 172.21.15.132:0/3176433093 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc402ae50 con 0x7f5fd00cdfe0 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.454+0000 7f5fce7fc640 1 -- 172.21.15.132:0/3176433093 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4032860 con 0x7f5fd00cdfe0 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 -- 172.21.15.132:0/3176433093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd00cdfe0 msgr2=0x7f5fd015e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/3176433093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd00cdfe0 0x7f5fd015e7c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5fd00ce430 tx=0x7f5fc402a300 comp rx=0 tx=0).stop 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 -- 172.21.15.132:0/3176433093 shutdown_connections 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/3176433093 >> v2:172.21.15.157:3300/0 conn(0x7f5fd015ed00 0x7f5fd00cb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/3176433093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd00cdfe0 0x7f5fd015e7c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 -- 172.21.15.132:0/3176433093 >> 172.21.15.132:0/3176433093 conn(0x7f5fd006c030 msgr2=0x7f5fd006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 -- 172.21.15.132:0/3176433093 shutdown_connections 2024-04-25T12:50:28.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.455+0000 7f5fd5d08640 1 -- 172.21.15.132:0/3176433093 wait complete. 2024-04-25T12:50:28.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.456+0000 7f5fd5d08640 1 Processor -- start 2024-04-25T12:50:28.455 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.456+0000 7f5fd5d08640 1 -- start start 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fd00cdfe0 0x7f5fd015e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 0x7f5fd0153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fd015ed00 0x7f5fd01f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd0155760 con 0x7f5fd0155380 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd00d10b0 con 0x7f5fd015ed00 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd01558e0 con 0x7f5fd00cdfe0 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 0x7f5fd0153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 0x7f5fd0153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35802/0 (socket says 172.21.15.132:35802) 2024-04-25T12:50:28.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 -- 172.21.15.132:0/1240270141 learned_addr learned my addr 172.21.15.132:0/1240270141 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fcf7fe640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fd00cdfe0 0x7f5fd015e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fcffff640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fd015ed00 0x7f5fd01f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 -- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fd00cdfe0 msgr2=0x7f5fd015e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fd00cdfe0 0x7f5fd015e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 -- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fd015ed00 msgr2=0x7f5fd01f0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fd015ed00 0x7f5fd01f0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 -- 172.21.15.132:0/1240270141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd014c230 con 0x7f5fd0155380 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fceffd640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 0x7f5fd0153cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fc402a340 tx=0x7f5fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4041070 con 0x7f5fd0155380 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc403c660 con 0x7f5fd0155380 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd015e7e0 con 0x7f5fd0155380 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.457+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc4037040 con 0x7f5fd0155380 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.458+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd0150570 con 0x7f5fd0155380 2024-04-25T12:50:28.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.458+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd0068d00 con 0x7f5fd0155380 2024-04-25T12:50:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.459+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fc4044070 con 0x7f5fd0155380 2024-04-25T12:50:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.459+0000 7f5fb7fff640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5fbc06c8f0 0x7f5fbc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.460+0000 7f5fcf7fe640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5fbc06c8f0 0x7f5fbc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.460+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5fc40ac620 con 0x7f5fd0155380 2024-04-25T12:50:28.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.460+0000 7f5fcf7fe640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5fbc06c8f0 0x7f5fbc06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0001780 tx=0x7f5fc0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.464+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fc407a030 con 0x7f5fd0155380 2024-04-25T12:50:28.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.637+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f5fd00cad60 con 0x7f5fd0155380 2024-04-25T12:50:28.635 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.637+0000 7f5fb7fff640 1 -- 172.21.15.132:0/1240270141 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f5fc407e330 con 0x7f5fd0155380 2024-04-25T12:50:28.635 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:28.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5fbc06c8f0 msgr2=0x7f5fbc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.637 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5fbc06c8f0 0x7f5fbc06edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0001780 tx=0x7f5fc0009040 comp rx=0 tx=0).stop 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 msgr2=0x7f5fd0153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 0x7f5fd0153cb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5fc402a340 tx=0x7f5fc40046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 shutdown_connections 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5fbc06c8f0 0x7f5fbc06edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f5fd015ed00 0x7f5fd01f0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5fd0155380 0x7f5fd0153cb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 --2- 172.21.15.132:0/1240270141 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f5fd00cdfe0 0x7f5fd015e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 >> 172.21.15.132:0/1240270141 conn(0x7f5fd006c030 msgr2=0x7f5fd00c6220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 shutdown_connections 2024-04-25T12:50:28.638 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.639+0000 7f5fd5d08640 1 -- 172.21.15.132:0/1240270141 wait complete. 2024-04-25T12:50:28.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:50:28.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.749+0000 7ff396b76640 1 Processor -- start 2024-04-25T12:50:28.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.749+0000 7ff396b76640 1 -- start start 2024-04-25T12:50:28.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff396b76640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff390144500 0x7ff39015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff396b76640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c9050 0x7ff3900c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff396b76640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff39006c360 0x7ff39015b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff396b76640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff39015ede0 con 0x7ff39006c360 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff396b76640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff3901448e0 con 0x7ff390144500 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff396b76640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff39015b9c0 con 0x7ff3900c9050 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff395113640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff39006c360 0x7ff39015b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff395113640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff39006c360 0x7ff39015b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35806/0 (socket says 172.21.15.132:35806) 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff395113640 1 -- 172.21.15.132:0/1241856931 learned_addr learned my addr 172.21.15.132:0/1241856931 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff394912640 1 --2- 172.21.15.132:0/1241856931 >> v2:172.21.15.157:3300/0 conn(0x7ff390144500 0x7ff39015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.750+0000 7ff38ffff640 1 --2- 172.21.15.132:0/1241856931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c9050 0x7ff3900c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff395113640 1 -- 172.21.15.132:0/1241856931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c9050 msgr2=0x7ff3900c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff395113640 1 --2- 172.21.15.132:0/1241856931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c9050 0x7ff3900c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff395113640 1 -- 172.21.15.132:0/1241856931 >> v2:172.21.15.157:3300/0 conn(0x7ff390144500 msgr2=0x7ff39015f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff395113640 1 --2- 172.21.15.132:0/1241856931 >> v2:172.21.15.157:3300/0 conn(0x7ff390144500 0x7ff39015f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff395113640 1 -- 172.21.15.132:0/1241856931 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff39015bca0 con 0x7ff39006c360 2024-04-25T12:50:28.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff394912640 1 --2- 172.21.15.132:0/1241856931 >> v2:172.21.15.157:3300/0 conn(0x7ff390144500 0x7ff39015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:28.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff395113640 1 --2- 172.21.15.132:0/1241856931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff39006c360 0x7ff39015b1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff390070c10 tx=0x7ff38802a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e94c513afda46d7f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff38f7fe640 1 -- 172.21.15.132:0/1241856931 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388036070 con 0x7ff39006c360 2024-04-25T12:50:28.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff38f7fe640 1 -- 172.21.15.132:0/1241856931 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff388031600 con 0x7ff39006c360 2024-04-25T12:50:28.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.751+0000 7ff38f7fe640 1 -- 172.21.15.132:0/1241856931 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3880319d0 con 0x7ff39006c360 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 -- 172.21.15.132:0/1241856931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff39006c360 msgr2=0x7ff39015b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 --2- 172.21.15.132:0/1241856931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff39006c360 0x7ff39015b1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7ff390070c10 tx=0x7ff38802a730 comp rx=0 tx=0).stop 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 -- 172.21.15.132:0/1241856931 shutdown_connections 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 --2- 172.21.15.132:0/1241856931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff39006c360 0x7ff39015b1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 --2- 172.21.15.132:0/1241856931 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff3900c9050 0x7ff3900c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 --2- 172.21.15.132:0/1241856931 >> v2:172.21.15.157:3300/0 conn(0x7ff390144500 0x7ff39015f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 -- 172.21.15.132:0/1241856931 >> 172.21.15.132:0/1241856931 conn(0x7ff390067630 msgr2=0x7ff390067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 -- 172.21.15.132:0/1241856931 shutdown_connections 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.752+0000 7ff396b76640 1 -- 172.21.15.132:0/1241856931 wait complete. 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.753+0000 7ff396b76640 1 Processor -- start 2024-04-25T12:50:28.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.753+0000 7ff396b76640 1 -- start start 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff396b76640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff39006c360 0x7ff390155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff396b76640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c9050 0x7ff3900cf100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff396b76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 0x7ff39015a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff396b76640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff39015ea70 con 0x7ff390144500 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff396b76640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff39015e790 con 0x7ff3900c9050 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff396b76640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff39015b6e0 con 0x7ff39006c360 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 0x7ff39015a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 0x7ff39015a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35810/0 (socket says 172.21.15.132:35810) 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 -- 172.21.15.132:0/133900928 learned_addr learned my addr 172.21.15.132:0/133900928 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff38ffff640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c9050 0x7ff3900cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff394912640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff39006c360 0x7ff390155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 -- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff39006c360 msgr2=0x7ff390155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff39006c360 0x7ff390155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 -- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c9050 msgr2=0x7ff3900cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c9050 0x7ff3900cf100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 -- 172.21.15.132:0/133900928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3901e5f50 con 0x7ff390144500 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.754+0000 7ff395113640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 0x7ff39015a260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff38802ad20 tx=0x7ff388004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.755+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff38803f020 con 0x7ff390144500 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.755+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff388037040 con 0x7ff390144500 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.755+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3901e6b40 con 0x7ff390144500 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.755+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff388036070 con 0x7ff390144500 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.755+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3901f1900 con 0x7ff390144500 2024-04-25T12:50:28.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.756+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3900cb580 con 0x7ff390144500 2024-04-25T12:50:28.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.756+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff388042020 con 0x7ff390144500 2024-04-25T12:50:28.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.757+0000 7ff38d7fa640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff37c06c920 0x7ff37c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:28.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.757+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff3880ac150 con 0x7ff390144500 2024-04-25T12:50:28.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.757+0000 7ff394912640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff37c06c920 0x7ff37c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:28.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.757+0000 7ff394912640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff37c06c920 0x7ff37c06ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff380006e80 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:28.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.761+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff3900cb580 con 0x7ff390144500 2024-04-25T12:50:28.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.935+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff390068d00 con 0x7ff390144500 2024-04-25T12:50:28.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.935+0000 7ff38d7fa640 1 -- 172.21.15.132:0/133900928 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7ff388049030 con 0x7ff390144500 2024-04-25T12:50:28.933 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff37c06c920 msgr2=0x7ff37c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff37c06c920 0x7ff37c06ede0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff380006e80 tx=0x7ff380008040 comp rx=0 tx=0).stop 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 msgr2=0x7ff39015a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 0x7ff39015a260 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff38802ad20 tx=0x7ff388004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 shutdown_connections 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff37c06c920 0x7ff37c06ede0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff390144500 0x7ff39015a260 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff3900c9050 0x7ff3900cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 --2- 172.21.15.132:0/133900928 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff39006c360 0x7ff390155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 >> 172.21.15.132:0/133900928 conn(0x7ff390067630 msgr2=0x7ff390142830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 shutdown_connections 2024-04-25T12:50:28.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:28.937+0000 7ff396b76640 1 -- 172.21.15.132:0/133900928 wait complete. 2024-04-25T12:50:28.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:50:29.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.048+0000 7f6788da2640 1 Processor -- start 2024-04-25T12:50:29.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.048+0000 7f6788da2640 1 -- start start 2024-04-25T12:50:29.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6788da2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f67840c71c0 0x7f678406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6788da2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678415cf20 con 0x7f67840c75a0 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6788da2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678415d200 con 0x7f67840ce360 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6788da2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f678415d4e0 con 0x7f67840c71c0 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6781d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f67840c75a0 0x7f678415c620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59994/0 (socket says 172.21.15.132:59994) 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6781d9b640 1 -- 172.21.15.132:0/3987655972 learned_addr learned my addr 172.21.15.132:0/3987655972 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678259c640 1 --2- 172.21.15.132:0/3987655972 >> v2:172.21.15.157:3300/0 conn(0x7f67840c71c0 0x7f678406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946471727 0 0) 0x7f678415cf20 con 0x7f67840c75a0 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f676c003520 con 0x7f67840c75a0 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3112069183 0 0) 0x7f676c003520 con 0x7f67840c75a0 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 >> v2:172.21.15.157:3300/0 conn(0x7f67840c71c0 msgr2=0x7f678406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 --2- 172.21.15.132:0/3987655972 >> v2:172.21.15.157:3300/0 conn(0x7f67840c71c0 0x7f678406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 >> v1:172.21.15.157:6789/0 conn(0x7f67840ce360 legacy=0x7f6784152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6784159140 con 0x7f67840c75a0 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f6778001670 con 0x7f67840c75a0 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 >> v1:172.21.15.132:6789/0 conn(0x7f67840c75a0 legacy=0x7f678415c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c0039b0 0x7f676c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c004800 0x7f676c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f676c0051c0 0x7f676c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f678415d4e0 con 0x7f676c0039b0 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f676c00c060 con 0x7f676c004800 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f676c00c260 con 0x7f676c0051c0 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f678259c640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c0039b0 0x7f676c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.049+0000 7f6781d9b640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c004800 0x7f676c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f6782d9d640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f676c0051c0 0x7f676c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678259c640 1 -- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f676c0051c0 msgr2=0x7f676c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678259c640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f676c0051c0 0x7f676c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678259c640 1 -- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c004800 msgr2=0x7f676c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678259c640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c004800 0x7f676c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678259c640 1 -- 172.21.15.132:0/3987655972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f676c003520 con 0x7f676c0039b0 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f6782d9d640 1 -- 172.21.15.132:0/3987655972 reap_dead start 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678259c640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c0039b0 0x7f676c003dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6774009ac0 tx=0x7f676c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=686a37a4892f79c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774036070 con 0x7f676c0039b0 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6774031400 con 0x7f676c0039b0 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.050+0000 7f678159a640 1 -- 172.21.15.132:0/3987655972 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6774009690 con 0x7f676c0039b0 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 -- 172.21.15.132:0/3987655972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c0039b0 msgr2=0x7f676c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c0039b0 0x7f676c003dd0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6774009ac0 tx=0x7f676c005830 comp rx=0 tx=0).stop 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 -- 172.21.15.132:0/3987655972 shutdown_connections 2024-04-25T12:50:29.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 --2- 172.21.15.132:0/3987655972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c0039b0 0x7f676c003dd0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 -- 172.21.15.132:0/3987655972 >> 172.21.15.132:0/3987655972 conn(0x7f67840cd840 msgr2=0x7f67840cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:29.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 -- 172.21.15.132:0/3987655972 shutdown_connections 2024-04-25T12:50:29.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.051+0000 7f6788da2640 1 -- 172.21.15.132:0/3987655972 wait complete. 2024-04-25T12:50:29.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.052+0000 7f6788da2640 1 Processor -- start 2024-04-25T12:50:29.054 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.052+0000 7f6788da2640 1 -- start start 2024-04-25T12:50:29.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6788da2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c0039b0 0x7f6784144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6788da2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67841ee900 0x7f67840c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6788da2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 0x7f6784148860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6788da2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f678406f700 con 0x7f67841f2810 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6788da2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67840c49b0 con 0x7f676c0039b0 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6788da2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f678406f880 con 0x7f67841ee900 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6782d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 0x7f6784148860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6782d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 0x7f6784148860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35826/0 (socket says 172.21.15.132:35826) 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6782d9d640 1 -- 172.21.15.132:0/936997036 learned_addr learned my addr 172.21.15.132:0/936997036 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f678259c640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c0039b0 0x7f6784144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6781d9b640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67841ee900 0x7f67840c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.053+0000 7f6782d9d640 1 -- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67841ee900 msgr2=0x7f67840c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6782d9d640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67841ee900 0x7f67840c9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6782d9d640 1 -- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c0039b0 msgr2=0x7f6784144bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6782d9d640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c0039b0 0x7f6784144bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6782d9d640 1 -- 172.21.15.132:0/936997036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6784145df0 con 0x7f67841f2810 2024-04-25T12:50:29.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6782d9d640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 0x7f6784148860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67840ce7f0 tx=0x7f677c00fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c003b80 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f677c018070 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f677c0050d0 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67841467f0 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.054+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67841f2010 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.055+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6784069ce0 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.055+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f677c005270 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.056+0000 7f6772ffd640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f676406c8f0 0x7f676406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.056+0000 7f678259c640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f676406c8f0 0x7f676406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.056+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f677c08bc40 con 0x7f67841f2810 2024-04-25T12:50:29.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.056+0000 7f678259c640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f676406c8f0 0x7f676406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6774033000 tx=0x7f6774008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.060+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f677c059d30 con 0x7f67841f2810 2024-04-25T12:50:29.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.235+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6784068d00 con 0x7f67841f2810 2024-04-25T12:50:29.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.236+0000 7f6772ffd640 1 -- 172.21.15.132:0/936997036 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f677c059630 con 0x7f67841f2810 2024-04-25T12:50:29.234 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f676406c8f0 msgr2=0x7f676406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f676406c8f0 0x7f676406edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6774033000 tx=0x7f6774008030 comp rx=0 tx=0).stop 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 msgr2=0x7f6784148860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 0x7f6784148860 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f67840ce7f0 tx=0x7f677c00fc70 comp rx=0 tx=0).stop 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 shutdown_connections 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f676406c8f0 0x7f676406edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67841f2810 0x7f6784148860 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67841ee900 0x7f67840c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 --2- 172.21.15.132:0/936997036 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f676c0039b0 0x7f6784144bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 >> 172.21.15.132:0/936997036 conn(0x7f67840cd840 msgr2=0x7f6784151c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:29.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 shutdown_connections 2024-04-25T12:50:29.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.238+0000 7f6788da2640 1 -- 172.21.15.132:0/936997036 wait complete. 2024-04-25T12:50:29.247 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:50:29.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 Processor -- start 2024-04-25T12:50:29.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 -- start start 2024-04-25T12:50:29.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1aa41557e0 0x7f1aa40cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cbf70 0x7f1aa406d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1aa40cc400 con 0x7f1aa40cc730 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1aa40cb5a0 con 0x7f1aa41557e0 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aaabad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa415ed80 con 0x7f1aa40cbf70 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.347+0000 7f1aa8949640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1aa41557e0 0x7f1aa40cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa8949640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1aa41557e0 0x7f1aa40cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35830/0 (socket says 172.21.15.132:35830) 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa8949640 1 -- 172.21.15.132:0/1625786510 learned_addr learned my addr 172.21.15.132:0/1625786510 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa914a640 1 --2- 172.21.15.132:0/1625786510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cbf70 0x7f1aa406d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa8949640 1 -- 172.21.15.132:0/1625786510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cbf70 msgr2=0x7f1aa406d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa8949640 1 --2- 172.21.15.132:0/1625786510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cbf70 0x7f1aa406d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa8949640 1 -- 172.21.15.132:0/1625786510 >> v1:172.21.15.157:6789/0 conn(0x7f1aa40cc730 legacy=0x7f1aa406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.348+0000 7f1aa8949640 1 -- 172.21.15.132:0/1625786510 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa415f060 con 0x7f1aa41557e0 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aa8949640 1 --2- 172.21.15.132:0/1625786510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40cba30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009e50 tx=0x7f1a9c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900f2b50e78f57ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aa37fe640 1 -- 172.21.15.132:0/1625786510 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c036070 con 0x7f1aa41557e0 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aa37fe640 1 -- 172.21.15.132:0/1625786510 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a9c031600 con 0x7f1aa41557e0 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aa37fe640 1 -- 172.21.15.132:0/1625786510 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c0319d0 con 0x7f1aa41557e0 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 -- 172.21.15.132:0/1625786510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 msgr2=0x7f1aa40cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 --2- 172.21.15.132:0/1625786510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40cba30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c009e50 tx=0x7f1a9c02a710 comp rx=0 tx=0).stop 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 -- 172.21.15.132:0/1625786510 shutdown_connections 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 --2- 172.21.15.132:0/1625786510 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cbf70 0x7f1aa406d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 --2- 172.21.15.132:0/1625786510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40cba30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 -- 172.21.15.132:0/1625786510 >> 172.21.15.132:0/1625786510 conn(0x7f1aa40d0e10 msgr2=0x7f1aa40d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 -- 172.21.15.132:0/1625786510 shutdown_connections 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.349+0000 7f1aaabad640 1 -- 172.21.15.132:0/1625786510 wait complete. 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.350+0000 7f1aaabad640 1 Processor -- start 2024-04-25T12:50:29.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.350+0000 7f1aaabad640 1 -- start start 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aaabad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa40cbf70 0x7f1aa41f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aaabad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cc730 0x7f1aa415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aaabad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aaabad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa406d610 con 0x7f1aa41557e0 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aaabad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1aa415f620 con 0x7f1aa40cbf70 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aaabad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1aa40cd0c0 con 0x7f1aa40cc730 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aa914a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aa914a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35836/0 (socket says 172.21.15.132:35836) 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.351+0000 7f1aa914a640 1 -- 172.21.15.132:0/3000528724 learned_addr learned my addr 172.21.15.132:0/3000528724 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa8949640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa40cbf70 0x7f1aa41f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa3fff640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cc730 0x7f1aa415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa914a640 1 -- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cc730 msgr2=0x7f1aa415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa914a640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cc730 0x7f1aa415c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa914a640 1 -- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa40cbf70 msgr2=0x7f1aa41f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa914a640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa40cbf70 0x7f1aa41f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa914a640 1 -- 172.21.15.132:0/3000528724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1aa414fae0 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa914a640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40c8f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c820 tx=0x7f1a9400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94015070 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a94004020 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1aa414f410 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a94004410 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.352+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1aa414f6b0 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.353+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1aa41f4f30 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.354+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1a94007830 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.354+0000 7f1aa17fa640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1a8406c8f0 0x7f1a8406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.354+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a9408bb90 con 0x7f1aa41557e0 2024-04-25T12:50:29.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.355+0000 7f1aa8949640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1a8406c8f0 0x7f1a8406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.355+0000 7f1aa8949640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1a8406c8f0 0x7f1a8406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c033000 tx=0x7f1a9c009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.359+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1aa41f4f30 con 0x7f1aa41557e0 2024-04-25T12:50:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.551+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1aa4153a10 con 0x7f1aa41557e0 2024-04-25T12:50:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.551+0000 7f1aa17fa640 1 -- 172.21.15.132:0/3000528724 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f1aa4153a10 con 0x7f1aa41557e0 2024-04-25T12:50:29.549 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1a8406c8f0 msgr2=0x7f1a8406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1a8406c8f0 0x7f1a8406edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1a9c033000 tx=0x7f1a9c009000 comp rx=0 tx=0).stop 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 msgr2=0x7f1aa40c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40c8f10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c820 tx=0x7f1a9400cce0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 shutdown_connections 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1a8406c8f0 0x7f1a8406edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1aa41557e0 0x7f1aa40c8f10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1aa40cc730 0x7f1aa415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 --2- 172.21.15.132:0/3000528724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1aa40cbf70 0x7f1aa41f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 >> 172.21.15.132:0/3000528724 conn(0x7f1aa40d0e10 msgr2=0x7f1aa40c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 shutdown_connections 2024-04-25T12:50:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.553+0000 7f1aaabad640 1 -- 172.21.15.132:0/3000528724 wait complete. 2024-04-25T12:50:29.562 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:50:29.562 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:50:29.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.715+0000 7feb852bb640 1 Processor -- start 2024-04-25T12:50:29.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.715+0000 7feb852bb640 1 -- start start 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb852bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb80153160 0x7feb800c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb852bb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7feb80158f10 0x7feb801593c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb852bb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb800c76a0 con 0x7feb80070050 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb852bb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7feb800c5900 con 0x7feb80153160 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb852bb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7feb800c4bd0 con 0x7feb80158f10 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb80153160 0x7feb800c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb80153160 0x7feb800c6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35852/0 (socket says 172.21.15.132:35852) 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 -- 172.21.15.132:0/108031375 learned_addr learned my addr 172.21.15.132:0/108031375 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7f7fe640 1 --2- 172.21.15.132:0/108031375 >> v2:172.21.15.157:3300/0 conn(0x7feb80158f10 0x7feb801593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 -- 172.21.15.132:0/108031375 >> v2:172.21.15.157:3300/0 conn(0x7feb80158f10 msgr2=0x7feb801593c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 --2- 172.21.15.132:0/108031375 >> v2:172.21.15.157:3300/0 conn(0x7feb80158f10 0x7feb801593c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 -- 172.21.15.132:0/108031375 >> v1:172.21.15.157:6789/0 conn(0x7feb80070050 legacy=0x7feb800c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7effd640 1 -- 172.21.15.132:0/108031375 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb800c7980 con 0x7feb80153160 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.716+0000 7feb7f7fe640 1 --2- 172.21.15.132:0/108031375 >> v2:172.21.15.157:3300/0 conn(0x7feb80158f10 0x7feb801593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.717+0000 7feb7effd640 1 --2- 172.21.15.132:0/108031375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80153160 0x7feb800c6760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb800cb580 tx=0x7feb7002a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f956fbdd987c2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.717+0000 7feb7dffb640 1 -- 172.21.15.132:0/108031375 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb70036070 con 0x7feb80153160 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.717+0000 7feb7dffb640 1 -- 172.21.15.132:0/108031375 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb70031600 con 0x7feb80153160 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.717+0000 7feb7dffb640 1 -- 172.21.15.132:0/108031375 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb700319d0 con 0x7feb80153160 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 -- 172.21.15.132:0/108031375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80153160 msgr2=0x7feb800c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 --2- 172.21.15.132:0/108031375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80153160 0x7feb800c6760 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feb800cb580 tx=0x7feb7002a730 comp rx=0 tx=0).stop 2024-04-25T12:50:29.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 -- 172.21.15.132:0/108031375 shutdown_connections 2024-04-25T12:50:29.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 --2- 172.21.15.132:0/108031375 >> v2:172.21.15.157:3300/0 conn(0x7feb80158f10 0x7feb801593c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 --2- 172.21.15.132:0/108031375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80153160 0x7feb800c6760 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 -- 172.21.15.132:0/108031375 >> 172.21.15.132:0/108031375 conn(0x7feb8006b930 msgr2=0x7feb8006bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:29.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 -- 172.21.15.132:0/108031375 shutdown_connections 2024-04-25T12:50:29.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.718+0000 7feb852bb640 1 -- 172.21.15.132:0/108031375 wait complete. 2024-04-25T12:50:29.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.719+0000 7feb852bb640 1 Processor -- start 2024-04-25T12:50:29.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.719+0000 7feb852bb640 1 -- start start 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb852bb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb80070050 0x7feb80158040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb852bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb80153160 0x7feb800cde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb852bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 0x7feb801ef310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb852bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feb800c5100 con 0x7feb80158f10 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb852bb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb800c5470 con 0x7feb80070050 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb852bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb80153540 con 0x7feb80153160 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 0x7feb801ef310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 0x7feb801ef310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35864/0 (socket says 172.21.15.132:35864) 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 -- 172.21.15.132:0/2964419776 learned_addr learned my addr 172.21.15.132:0/2964419776 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7effd640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb80070050 0x7feb80158040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7e7fc640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb80153160 0x7feb800cde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 -- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb80153160 msgr2=0x7feb800cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb80153160 0x7feb800cde70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 -- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb80070050 msgr2=0x7feb80158040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb80070050 0x7feb80158040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 -- 172.21.15.132:0/2964419776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb801effa0 con 0x7feb80158f10 2024-04-25T12:50:29.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb7f7fe640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 0x7feb801ef310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb7800d7d0 tx=0x7feb7800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.720+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb78004030 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.721+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb780041d0 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.721+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8015b010 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.721+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb780096a0 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.721+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8015b2d0 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.722+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb80068c20 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.722+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb78009840 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.722+0000 7feb677fe640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb6c06c8f0 0x7feb6c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.723+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb7808c010 con 0x7feb80158f10 2024-04-25T12:50:29.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.723+0000 7feb7effd640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb6c06c8f0 0x7feb6c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:29.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.723+0000 7feb7effd640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb6c06c8f0 0x7feb6c06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb70033000 tx=0x7feb70009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:29.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.727+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb80068c20 con 0x7feb80158f10 2024-04-25T12:50:29.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.906+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb800741e0 con 0x7feb80158f10 2024-04-25T12:50:29.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.907+0000 7feb677fe640 1 -- 172.21.15.132:0/2964419776 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7feb78059b40 con 0x7feb80158f10 2024-04-25T12:50:29.906 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:29.906 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:29.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb6c06c8f0 msgr2=0x7feb6c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb6c06c8f0 0x7feb6c06edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7feb70033000 tx=0x7feb70009000 comp rx=0 tx=0).stop 2024-04-25T12:50:29.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 msgr2=0x7feb801ef310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:29.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 0x7feb801ef310 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb7800d7d0 tx=0x7feb7800dc90 comp rx=0 tx=0).stop 2024-04-25T12:50:29.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 shutdown_connections 2024-04-25T12:50:29.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb6c06c8f0 0x7feb6c06edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb80158f10 0x7feb801ef310 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb80153160 0x7feb800cde70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 --2- 172.21.15.132:0/2964419776 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb80070050 0x7feb80158040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:29.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 >> 172.21.15.132:0/2964419776 conn(0x7feb8006b930 msgr2=0x7feb8006f380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:29.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 shutdown_connections 2024-04-25T12:50:29.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:29.909+0000 7feb852bb640 1 -- 172.21.15.132:0/2964419776 wait complete. 2024-04-25T12:50:29.919 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:50:11.154024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:50:11.639000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:50:15.365379+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:50:29.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.022+0000 7f124ad01640 1 Processor -- start 2024-04-25T12:50:30.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.022+0000 7f124ad01640 1 -- start start 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124ad01640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f12440c9050 0x7f124415f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124ad01640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f124406c360 0x7f12440c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124ad01640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f12441448e0 con 0x7f1244144500 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124ad01640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f124415ede0 con 0x7f124406c360 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124ad01640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f124415b9c0 con 0x7f12440c9050 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124929e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f124406c360 0x7f12440c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f1248a9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1244144500 0x7f124415b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59998/0 (socket says 172.21.15.132:59998) 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f1248a9d640 1 -- 172.21.15.132:0/3399399511 learned_addr learned my addr 172.21.15.132:0/3399399511 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f1243fff640 1 --2- 172.21.15.132:0/3399399511 >> v2:172.21.15.157:3300/0 conn(0x7f12440c9050 0x7f124415f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124929e640 1 -- 172.21.15.132:0/3399399511 >> v2:172.21.15.157:3300/0 conn(0x7f12440c9050 msgr2=0x7f124415f270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:30.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124929e640 1 --2- 172.21.15.132:0/3399399511 >> v2:172.21.15.157:3300/0 conn(0x7f12440c9050 0x7f124415f270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124929e640 1 -- 172.21.15.132:0/3399399511 >> v1:172.21.15.132:6789/0 conn(0x7f1244144500 legacy=0x7f124415b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f12437fe640 1 -- 172.21.15.132:0/3399399511 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576224534 0 0) 0x7f12441448e0 con 0x7f1244144500 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.023+0000 7f124929e640 1 -- 172.21.15.132:0/3399399511 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124415bca0 con 0x7f124406c360 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124929e640 1 --2- 172.21.15.132:0/3399399511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f124406c360 0x7f12440c9e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12440cbda0 tx=0x7f123c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fb5f52d0710f2e6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f12437fe640 1 -- 172.21.15.132:0/3399399511 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c007740 con 0x7f124406c360 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f12437fe640 1 -- 172.21.15.132:0/3399399511 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f123c0078e0 con 0x7f124406c360 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f12437fe640 1 -- 172.21.15.132:0/3399399511 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c007cb0 con 0x7f124406c360 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 -- 172.21.15.132:0/3399399511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f124406c360 msgr2=0x7f12440c9e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 --2- 172.21.15.132:0/3399399511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f124406c360 0x7f12440c9e50 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f12440cbda0 tx=0x7f123c02a710 comp rx=0 tx=0).stop 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 -- 172.21.15.132:0/3399399511 shutdown_connections 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 --2- 172.21.15.132:0/3399399511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f124406c360 0x7f12440c9e50 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 --2- 172.21.15.132:0/3399399511 >> v2:172.21.15.157:3300/0 conn(0x7f12440c9050 0x7f124415f270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 -- 172.21.15.132:0/3399399511 >> 172.21.15.132:0/3399399511 conn(0x7f1244067630 msgr2=0x7f1244067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 -- 172.21.15.132:0/3399399511 shutdown_connections 2024-04-25T12:50:30.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.024+0000 7f124ad01640 1 -- 172.21.15.132:0/3399399511 wait complete. 2024-04-25T12:50:30.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 Processor -- start 2024-04-25T12:50:30.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 -- start start 2024-04-25T12:50:30.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124406c360 0x7f1244142e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 0x7f12441f1ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1244144500 0x7f1244158070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f124415ea70 con 0x7f12440c9050 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f124415e790 con 0x7f124406c360 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.026+0000 7f124ad01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1244070ef0 con 0x7f1244144500 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 0x7f12441f1ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 0x7f12441f1ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35882/0 (socket says 172.21.15.132:35882) 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 -- 172.21.15.132:0/3723631038 learned_addr learned my addr 172.21.15.132:0/3723631038 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f124929e640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1244144500 0x7f1244158070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1248a9d640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124406c360 0x7f1244142e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 -- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1244144500 msgr2=0x7f1244158070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1244144500 0x7f1244158070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 -- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124406c360 msgr2=0x7f1244142e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124406c360 0x7f1244142e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 -- 172.21.15.132:0/3723631038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1244159a20 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f1243fff640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 0x7f12441f1ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f123000d860 tx=0x7f123000dd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123000de50 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1230019070 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12440c8af0 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123000ba90 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.027+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1244159fc0 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.028+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1244068d00 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.029+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f123000bc30 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.029+0000 7f12417fa640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f122806c8f0 0x7f122806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.029+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f123008c0e0 con 0x7f12440c9050 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.029+0000 7f1248a9d640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f122806c8f0 0x7f122806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.029+0000 7f1248a9d640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f122806c8f0 0x7f122806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1238007fd0 tx=0x7f1238007de0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.033+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1230059c10 con 0x7f12440c9050 2024-04-25T12:50:30.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.207+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f124415a720 con 0x7f12440c9050 2024-04-25T12:50:30.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.207+0000 7f12417fa640 1 -- 172.21.15.132:0/3723631038 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f123005df10 con 0x7f12440c9050 2024-04-25T12:50:30.206 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:30.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f122806c8f0 msgr2=0x7f122806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f122806c8f0 0x7f122806edb0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1238007fd0 tx=0x7f1238007de0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 msgr2=0x7f12441f1ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 0x7f12441f1ba0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f123000d860 tx=0x7f123000dd20 comp rx=0 tx=0).stop 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 shutdown_connections 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f122806c8f0 0x7f122806edb0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1244144500 0x7f1244158070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12440c9050 0x7f12441f1ba0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 --2- 172.21.15.132:0/3723631038 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f124406c360 0x7f1244142e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 >> 172.21.15.132:0/3723631038 conn(0x7f1244067630 msgr2=0x7f12440cd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 shutdown_connections 2024-04-25T12:50:30.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.209+0000 7f124ad01640 1 -- 172.21.15.132:0/3723631038 wait complete. 2024-04-25T12:50:30.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:50:30.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 Processor -- start 2024-04-25T12:50:30.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 -- start start 2024-04-25T12:50:30.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c0ca880 0x7f253c0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f253c0c8540 0x7f253c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f253c0c9750 con 0x7f253c152280 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f253c158f60 con 0x7f253c0c8540 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f2541ff7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f253c1581a0 con 0x7f253c0ca880 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.321+0000 7f253bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f253c0c8540 0x7f253c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f253c152280 0x7f253c15b580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60004/0 (socket says 172.21.15.132:60004) 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253b7fe640 1 -- 172.21.15.132:0/3066739569 learned_addr learned my addr 172.21.15.132:0/3066739569 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253bfff640 1 --2- 172.21.15.132:0/3066739569 >> v2:172.21.15.132:3300/0 conn(0x7f253c0c8540 0x7f253c0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35898/0 (socket says 172.21.15.132:35898) 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f2532ffd640 1 --2- 172.21.15.132:0/3066739569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c0ca880 0x7f253c0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253bfff640 1 -- 172.21.15.132:0/3066739569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c0ca880 msgr2=0x7f253c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253bfff640 1 --2- 172.21.15.132:0/3066739569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c0ca880 0x7f253c0cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253bfff640 1 -- 172.21.15.132:0/3066739569 >> v1:172.21.15.132:6789/0 conn(0x7f253c152280 legacy=0x7f253c15b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253bfff640 1 -- 172.21.15.132:0/3066739569 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c158480 con 0x7f253c0c8540 2024-04-25T12:50:30.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253affd640 1 -- 172.21.15.132:0/3066739569 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759530590 0 0) 0x7f253c0c9750 con 0x7f253c152280 2024-04-25T12:50:30.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.322+0000 7f253bfff640 1 --2- 172.21.15.132:0/3066739569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0c8540 0x7f253c0cba70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2534009d90 tx=0x7f253402a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67fdf12901d163c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f253affd640 1 -- 172.21.15.132:0/3066739569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534007740 con 0x7f253c0c8540 2024-04-25T12:50:30.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f253affd640 1 -- 172.21.15.132:0/3066739569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25340078e0 con 0x7f253c0c8540 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f253affd640 1 -- 172.21.15.132:0/3066739569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2534007cb0 con 0x7f253c0c8540 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 -- 172.21.15.132:0/3066739569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0c8540 msgr2=0x7f253c0cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 --2- 172.21.15.132:0/3066739569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0c8540 0x7f253c0cba70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2534009d90 tx=0x7f253402a6f0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 -- 172.21.15.132:0/3066739569 shutdown_connections 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 --2- 172.21.15.132:0/3066739569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0c8540 0x7f253c0cba70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 --2- 172.21.15.132:0/3066739569 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c0ca880 0x7f253c0cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 -- 172.21.15.132:0/3066739569 >> 172.21.15.132:0/3066739569 conn(0x7f253c06b930 msgr2=0x7f253c06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 -- 172.21.15.132:0/3066739569 shutdown_connections 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.323+0000 7f2541ff7640 1 -- 172.21.15.132:0/3066739569 wait complete. 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.324+0000 7f2541ff7640 1 Processor -- start 2024-04-25T12:50:30.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 -- start start 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f253c0c8540 0x7f253c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 0x7f253c1f16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c152280 0x7f253c15b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f253c152660 con 0x7f253c0ca880 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f253c158a40 con 0x7f253c0c8540 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2541ff7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f253c0c47d0 con 0x7f253c152280 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2532ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 0x7f253c1f16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2532ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 0x7f253c1f16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35906/0 (socket says 172.21.15.132:35906) 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f2532ffd640 1 -- 172.21.15.132:0/70474355 learned_addr learned my addr 172.21.15.132:0/70474355 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.325+0000 7f253bfff640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c152280 0x7f253c15b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f253b7fe640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f253c0c8540 0x7f253c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2532ffd640 1 -- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c152280 msgr2=0x7f253c15b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2532ffd640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c152280 0x7f253c15b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2532ffd640 1 -- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f253c0c8540 msgr2=0x7f253c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2532ffd640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f253c0c8540 0x7f253c157b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2532ffd640 1 -- 172.21.15.132:0/70474355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f253c1538f0 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2532ffd640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 0x7f253c1f16b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2524007e90 tx=0x7f252400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252400ba50 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252400bbf0 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f253c1f2330 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252400de50 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.326+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f253c1f2050 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.327+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f253c0741e0 con 0x7f253c0ca880 2024-04-25T12:50:30.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.327+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2524019020 con 0x7f253c0ca880 2024-04-25T12:50:30.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.328+0000 7f2538ff9640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f251c06c920 0x7f251c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.328+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f252408dda0 con 0x7f253c0ca880 2024-04-25T12:50:30.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.328+0000 7f253b7fe640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f251c06c920 0x7f251c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.328+0000 7f253b7fe640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f251c06c920 0x7f251c06ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f252c000f60 tx=0x7f252c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.332+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f252405be00 con 0x7f253c0ca880 2024-04-25T12:50:30.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.509+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f253c071e60 con 0x7f253c0ca880 2024-04-25T12:50:30.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.510+0000 7f2538ff9640 1 -- 172.21.15.132:0/70474355 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f252405b700 con 0x7f253c0ca880 2024-04-25T12:50:30.508 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:30.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f251c06c920 msgr2=0x7f251c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f251c06c920 0x7f251c06ede0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f252c000f60 tx=0x7f252c009040 comp rx=0 tx=0).stop 2024-04-25T12:50:30.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 msgr2=0x7f253c1f16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 0x7f253c1f16b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2524007e90 tx=0x7f252400dc00 comp rx=0 tx=0).stop 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 shutdown_connections 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f251c06c920 0x7f251c06ede0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f253c152280 0x7f253c15b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f253c0ca880 0x7f253c1f16b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 --2- 172.21.15.132:0/70474355 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f253c0c8540 0x7f253c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 >> 172.21.15.132:0/70474355 conn(0x7f253c06b930 msgr2=0x7f253c06f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 shutdown_connections 2024-04-25T12:50:30.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.512+0000 7f2541ff7640 1 -- 172.21.15.132:0/70474355 wait complete. 2024-04-25T12:50:30.521 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:50:30.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.622+0000 7f504487c640 1 Processor -- start 2024-04-25T12:50:30.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.622+0000 7f504487c640 1 -- start start 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f504487c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5040144500 0x7f504015f270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f504487c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f504006c360 0x7f50400c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f504487c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50401448e0 con 0x7f50400c9050 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f504487c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f504015ede0 con 0x7f5040144500 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f504487c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f504015b9c0 con 0x7f504006c360 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5040144500 0x7f504015f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5040144500 0x7f504015f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35912/0 (socket says 172.21.15.132:35912) 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f50400c9050 0x7f504015b1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60014/0 (socket says 172.21.15.132:60014) 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 -- 172.21.15.132:0/3785356578 learned_addr learned my addr 172.21.15.132:0/3785356578 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503ed9d640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f504006c360 0x7f50400c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 -- 172.21.15.132:0/3785356578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f504006c360 msgr2=0x7f50400c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:30.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f504006c360 0x7f50400c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 -- 172.21.15.132:0/3785356578 >> v1:172.21.15.132:6789/0 conn(0x7f50400c9050 legacy=0x7f504015b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503d59a640 1 -- 172.21.15.132:0/3785356578 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562865707 0 0) 0x7f50401448e0 con 0x7f50400c9050 2024-04-25T12:50:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503e59c640 1 -- 172.21.15.132:0/3785356578 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f504015bca0 con 0x7f5040144500 2024-04-25T12:50:30.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.623+0000 7f503ed9d640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f504006c360 0x7f50400c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:30.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.624+0000 7f503e59c640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f504015f270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5030009e50 tx=0x7f503002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c64caeb08fab0c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.624+0000 7f503d59a640 1 -- 172.21.15.132:0/3785356578 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5030036070 con 0x7f5040144500 2024-04-25T12:50:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.624+0000 7f503d59a640 1 -- 172.21.15.132:0/3785356578 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5030031600 con 0x7f5040144500 2024-04-25T12:50:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.624+0000 7f503d59a640 1 -- 172.21.15.132:0/3785356578 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50300319d0 con 0x7f5040144500 2024-04-25T12:50:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 -- 172.21.15.132:0/3785356578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 msgr2=0x7f504015f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f504015f270 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5030009e50 tx=0x7f503002a7a0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 -- 172.21.15.132:0/3785356578 shutdown_connections 2024-04-25T12:50:30.625 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f504006c360 0x7f50400c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 --2- 172.21.15.132:0/3785356578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f504015f270 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 -- 172.21.15.132:0/3785356578 >> 172.21.15.132:0/3785356578 conn(0x7f5040067630 msgr2=0x7f5040067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 -- 172.21.15.132:0/3785356578 shutdown_connections 2024-04-25T12:50:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.625+0000 7f504487c640 1 -- 172.21.15.132:0/3785356578 wait complete. 2024-04-25T12:50:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.626+0000 7f504487c640 1 Processor -- start 2024-04-25T12:50:30.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.626+0000 7f504487c640 1 -- start start 2024-04-25T12:50:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f504006c360 0x7f50401f13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50400c9050 0x7f50401e4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f50401e4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.630 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f504015ea70 con 0x7f5040144500 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f504015e790 con 0x7f504006c360 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f5040070ef0 con 0x7f50400c9050 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f50401e4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f50401e4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35924/0 (socket says 172.21.15.132:35924) 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 -- 172.21.15.132:0/1181059114 learned_addr learned my addr 172.21.15.132:0/1181059114 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503e59c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f504006c360 0x7f50401f13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503dd9b640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50400c9050 0x7f50401e4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 -- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50400c9050 msgr2=0x7f50401e4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50400c9050 0x7f50401e4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 -- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f504006c360 msgr2=0x7f50401f13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f504006c360 0x7f50401f13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 -- 172.21.15.132:0/1181059114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50400cf130 con 0x7f5040144500 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503dd9b640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50400c9050 0x7f50401e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:30.631 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f503ed9d640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f50401e4e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f503800c5e0 tx=0x7f503800caa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038015070 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5038011840 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50400ce890 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5038011c30 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.627+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50400cee50 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.628+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5040070050 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.629+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5038018070 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.629+0000 7f502effd640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f502006c8f0 0x7f502006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.629+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f503808bd80 con 0x7f5040144500 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.629+0000 7f503e59c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f502006c8f0 0x7f502006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.630+0000 7f503e59c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f502006c8f0 0x7f502006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5030033000 tx=0x7f5030009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.633 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.634+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5040070050 con 0x7f5040144500 2024-04-25T12:50:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.808+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5040068d00 con 0x7f5040144500 2024-04-25T12:50:30.806 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.808+0000 7f502effd640 1 -- 172.21.15.132:0/1181059114 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f5038059e70 con 0x7f5040144500 2024-04-25T12:50:30.807 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-25T12:50:30.808 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f502006c8f0 msgr2=0x7f502006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f502006c8f0 0x7f502006edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5030033000 tx=0x7f5030009000 comp rx=0 tx=0).stop 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 msgr2=0x7f50401e4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f50401e4e80 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f503800c5e0 tx=0x7f503800caa0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 shutdown_connections 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f502006c8f0 0x7f502006edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5040144500 0x7f50401e4e80 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f50400c9050 0x7f50401e4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 --2- 172.21.15.132:0/1181059114 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f504006c360 0x7f50401f13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 >> 172.21.15.132:0/1181059114 conn(0x7f5040067630 msgr2=0x7f5040067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 shutdown_connections 2024-04-25T12:50:30.809 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.810+0000 7f504487c640 1 -- 172.21.15.132:0/1181059114 wait complete. 2024-04-25T12:50:30.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:50:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.920+0000 7f7fd0aa7640 1 Processor -- start 2024-04-25T12:50:30.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.920+0000 7f7fd0aa7640 1 -- start start 2024-04-25T12:50:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fd0aa7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc1556d0 0x7f7fcc15f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fd0aa7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fcc0cb8f0 0x7f7fcc0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fd0aa7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fcc15bb40 con 0x7f7fcc0c63a0 2024-04-25T12:50:30.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fd0aa7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7fcc0cc2d0 con 0x7f7fcc0cb8f0 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fd0aa7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc15f800 con 0x7f7fcc1556d0 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fcad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fcc0cb8f0 0x7f7fcc0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fc9d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7fcc0c63a0 0x7f7fcc15b300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60030/0 (socket says 172.21.15.132:60030) 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fcad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fcc0cb8f0 0x7f7fcc0c58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35930/0 (socket says 172.21.15.132:35930) 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fc9d9b640 1 -- 172.21.15.132:0/449819705 learned_addr learned my addr 172.21.15.132:0/449819705 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.921+0000 7f7fca59c640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc1556d0 0x7f7fcc15f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fcad9d640 1 -- 172.21.15.132:0/449819705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc1556d0 msgr2=0x7f7fcc15f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fcad9d640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc1556d0 0x7f7fcc15f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fcad9d640 1 -- 172.21.15.132:0/449819705 >> v1:172.21.15.132:6789/0 conn(0x7f7fcc0c63a0 legacy=0x7f7fcc15b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fcad9d640 1 -- 172.21.15.132:0/449819705 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc15be20 con 0x7f7fcc0cb8f0 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fc959a640 1 -- 172.21.15.132:0/449819705 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3044475020 0 0) 0x7f7fcc15bb40 con 0x7f7fcc0c63a0 2024-04-25T12:50:30.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fca59c640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc1556d0 0x7f7fcc15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fcad9d640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc0c58b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40097a0 tx=0x7f7fc402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda7420de92a185e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fc959a640 1 -- 172.21.15.132:0/449819705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4037070 con 0x7f7fcc0cb8f0 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fc959a640 1 -- 172.21.15.132:0/449819705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc4032440 con 0x7f7fcc0cb8f0 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.922+0000 7f7fc959a640 1 -- 172.21.15.132:0/449819705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4032810 con 0x7f7fcc0cb8f0 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/449819705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc0cb8f0 msgr2=0x7f7fcc0c58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc0c58b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40097a0 tx=0x7f7fc402a180 comp rx=0 tx=0).stop 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/449819705 shutdown_connections 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc0c58b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/449819705 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc1556d0 0x7f7fcc15f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/449819705 >> 172.21.15.132:0/449819705 conn(0x7f7fcc067630 msgr2=0x7f7fcc067a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/449819705 shutdown_connections 2024-04-25T12:50:30.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.923+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/449819705 wait complete. 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.924+0000 7f7fd0aa7640 1 Processor -- start 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.924+0000 7f7fd0aa7640 1 -- start start 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fd0aa7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc0c63a0 0x7f7fcc0d0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fd0aa7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc156a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fd0aa7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 0x7f7fcc1f0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fd0aa7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc15ee30 con 0x7f7fcc1556d0 2024-04-25T12:50:30.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fd0aa7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7fcc15e870 con 0x7f7fcc0cb8f0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fd0aa7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7fcc155ab0 con 0x7f7fcc0c63a0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 0x7f7fcc1f0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 0x7f7fcc1f0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35940/0 (socket says 172.21.15.132:35940) 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 -- 172.21.15.132:0/3323714754 learned_addr learned my addr 172.21.15.132:0/3323714754 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fc9d9b640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc156a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fca59c640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc0c63a0 0x7f7fcc0d0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 -- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc0c63a0 msgr2=0x7f7fcc0d0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc0c63a0 0x7f7fcc0d0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 -- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fcc0cb8f0 msgr2=0x7f7fcc156a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc156a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.925+0000 7f7fcad9d640 1 -- 172.21.15.132:0/3323714754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fcc0cf220 con 0x7f7fcc1556d0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.926+0000 7f7fcad9d640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 0x7f7fcc1f0e80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4035040 tx=0x7f7fc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.926+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4037050 con 0x7f7fcc1556d0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.926+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7fc4038040 con 0x7f7fcc1556d0 2024-04-25T12:50:30.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.926+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fcc155ec0 con 0x7f7fcc1556d0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.926+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fc4004490 con 0x7f7fcc1556d0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.926+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fcc0cebd0 con 0x7f7fcc1556d0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.927+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fcc068d00 con 0x7f7fcc1556d0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.927+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7fc4030980 con 0x7f7fcc1556d0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.928+0000 7f7fbaffd640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7fac06c8f0 0x7f7fac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.928+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7fc40acd70 con 0x7f7fcc1556d0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.928+0000 7f7fca59c640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7fac06c8f0 0x7f7fac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.928+0000 7f7fca59c640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7fac06c8f0 0x7f7fac06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc008ee0 tx=0x7f7fbc008430 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:30.932+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7fc4032e20 con 0x7f7fcc1556d0 2024-04-25T12:50:31.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.105+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7fcc0ccbe0 con 0x7f7fcc1556d0 2024-04-25T12:50:31.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.105+0000 7f7fbaffd640 1 -- 172.21.15.132:0/3323714754 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f7fc407ae70 con 0x7f7fcc1556d0 2024-04-25T12:50:31.103 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7fac06c8f0 msgr2=0x7f7fac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7fac06c8f0 0x7f7fac06edb0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc008ee0 tx=0x7f7fbc008430 comp rx=0 tx=0).stop 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 msgr2=0x7f7fcc1f0e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 0x7f7fcc1f0e80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7fc4035040 tx=0x7f7fc40046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 shutdown_connections 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7fac06c8f0 0x7f7fac06edb0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fcc1556d0 0x7f7fcc1f0e80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7fcc0cb8f0 0x7f7fcc156a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 --2- 172.21.15.132:0/3323714754 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7fcc0c63a0 0x7f7fcc0d0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 >> 172.21.15.132:0/3323714754 conn(0x7f7fcc067630 msgr2=0x7f7fcc0728f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 shutdown_connections 2024-04-25T12:50:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.107+0000 7f7fd0aa7640 1 -- 172.21.15.132:0/3323714754 wait complete. 2024-04-25T12:50:31.116 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:50:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.216+0000 7fb95966b640 1 Processor -- start 2024-04-25T12:50:31.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.216+0000 7fb95966b640 1 -- start start 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb95966b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9541557e0 0x7fb9540cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb95966b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9540cc730 0x7fb9540cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb95966b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb95415ed80 con 0x7fb95406c9c0 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb95966b640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb9540cb5a0 con 0x7fb9540cc730 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb95966b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb95415f060 con 0x7fb9541557e0 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb952ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9541557e0 0x7fb9540cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb9527fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb9540cc730 0x7fb9540cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb9537fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fb95406c9c0 0x7fb95406ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:42854/0 (socket says 172.21.15.132:42854) 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb9537fe640 1 -- 172.21.15.132:0/4063322808 learned_addr learned my addr 172.21.15.132:0/4063322808 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb952ffd640 1 -- 172.21.15.132:0/4063322808 >> v2:172.21.15.157:3300/0 conn(0x7fb9540cc730 msgr2=0x7fb9540cbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:31.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.217+0000 7fb952ffd640 1 --2- 172.21.15.132:0/4063322808 >> v2:172.21.15.157:3300/0 conn(0x7fb9540cc730 0x7fb9540cbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb952ffd640 1 -- 172.21.15.132:0/4063322808 >> v1:172.21.15.157:6789/0 conn(0x7fb95406c9c0 legacy=0x7fb95406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb952ffd640 1 -- 172.21.15.132:0/4063322808 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb95415f340 con 0x7fb9541557e0 2024-04-25T12:50:31.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb9527fc640 1 --2- 172.21.15.132:0/4063322808 >> v2:172.21.15.157:3300/0 conn(0x7fb9540cc730 0x7fb9540cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:31.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb952ffd640 1 --2- 172.21.15.132:0/4063322808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9541557e0 0x7fb9540cba30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097a0 tx=0x7fb94402a180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b98dfafd4a7d114d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:31.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb951ffb640 1 -- 172.21.15.132:0/4063322808 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944037070 con 0x7fb9541557e0 2024-04-25T12:50:31.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb951ffb640 1 -- 172.21.15.132:0/4063322808 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb944032440 con 0x7fb9541557e0 2024-04-25T12:50:31.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.218+0000 7fb951ffb640 1 -- 172.21.15.132:0/4063322808 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb944032810 con 0x7fb9541557e0 2024-04-25T12:50:31.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 -- 172.21.15.132:0/4063322808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9541557e0 msgr2=0x7fb9540cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.218 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 --2- 172.21.15.132:0/4063322808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9541557e0 0x7fb9540cba30 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb9440097a0 tx=0x7fb94402a180 comp rx=0 tx=0).stop 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 -- 172.21.15.132:0/4063322808 shutdown_connections 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 --2- 172.21.15.132:0/4063322808 >> v2:172.21.15.157:3300/0 conn(0x7fb9540cc730 0x7fb9540cbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 --2- 172.21.15.132:0/4063322808 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9541557e0 0x7fb9540cba30 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 -- 172.21.15.132:0/4063322808 >> 172.21.15.132:0/4063322808 conn(0x7fb9540d0e10 msgr2=0x7fb9540d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 -- 172.21.15.132:0/4063322808 shutdown_connections 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.219+0000 7fb95966b640 1 -- 172.21.15.132:0/4063322808 wait complete. 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.220+0000 7fb95966b640 1 Processor -- start 2024-04-25T12:50:31.219 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.220+0000 7fb95966b640 1 -- start start 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb95966b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb95406c9c0 0x7fb9540cf9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb95966b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9540cc730 0x7fb9541f1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb95966b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 0x7fb9540c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb95966b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb95406d6b0 con 0x7fb9541557e0 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb95966b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb95406d530 con 0x7fb95406c9c0 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb95966b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb9540cd0c0 con 0x7fb9540cc730 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 0x7fb9540c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 0x7fb9540c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35946/0 (socket says 172.21.15.132:35946) 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 -- 172.21.15.132:0/2693913383 learned_addr learned my addr 172.21.15.132:0/2693913383 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9527fc640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9540cc730 0x7fb9541f1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb952ffd640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb95406c9c0 0x7fb9540cf9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 -- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9540cc730 msgr2=0x7fb9541f1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9540cc730 0x7fb9541f1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 -- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb95406c9c0 msgr2=0x7fb9540cf9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb95406c9c0 0x7fb9540cf9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.221+0000 7fb9537fe640 1 -- 172.21.15.132:0/2693913383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9541f18a0 con 0x7fb9541557e0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.222+0000 7fb9537fe640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 0x7fb9540c5ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00cbc0 tx=0x7fb94c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.222+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c017070 con 0x7fb9541557e0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.222+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb94c00ad40 con 0x7fb9541557e0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.222+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9540cf2b0 con 0x7fb9541557e0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.222+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c012600 con 0x7fb9541557e0 2024-04-25T12:50:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.222+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9540cf570 con 0x7fb9541557e0 2024-04-25T12:50:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.223+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9540cf7b0 con 0x7fb9541557e0 2024-04-25T12:50:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.223+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb94c01a070 con 0x7fb9541557e0 2024-04-25T12:50:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.224+0000 7fb93b7fe640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb94006c8f0 0x7fb94006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.224+0000 7fb952ffd640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb94006c8f0 0x7fb94006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.224+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb94c08bae0 con 0x7fb9541557e0 2024-04-25T12:50:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.224+0000 7fb952ffd640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb94006c8f0 0x7fb94006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb944034000 tx=0x7fb94402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:31.226 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.228+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb9540cf7b0 con 0x7fb9541557e0 2024-04-25T12:50:31.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.414+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb954068c20 con 0x7fb9541557e0 2024-04-25T12:50:31.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.415+0000 7fb93b7fe640 1 -- 172.21.15.132:0/2693913383 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fb94c059580 con 0x7fb9541557e0 2024-04-25T12:50:31.413 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-25T12:50:31.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb94006c8f0 msgr2=0x7fb94006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb94006c8f0 0x7fb94006edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb944034000 tx=0x7fb94402e000 comp rx=0 tx=0).stop 2024-04-25T12:50:31.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 msgr2=0x7fb9540c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:31.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 0x7fb9540c5ba0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00cbc0 tx=0x7fb94c00a430 comp rx=0 tx=0).stop 2024-04-25T12:50:31.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 shutdown_connections 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb94006c8f0 0x7fb94006edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9541557e0 0x7fb9540c5ba0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb9540cc730 0x7fb9541f1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 --2- 172.21.15.132:0/2693913383 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb95406c9c0 0x7fb9540cf9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 >> 172.21.15.132:0/2693913383 conn(0x7fb9540d0e10 msgr2=0x7fb954154990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 shutdown_connections 2024-04-25T12:50:31.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:31.417+0000 7fb95966b640 1 -- 172.21.15.132:0/2693913383 wait complete. 2024-04-25T12:50:31.426 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2024-04-25T12:50:31.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:31.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-25T12:50:31.448 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi132.stderr:ceph-fuse[41911]: fuse finished with error 0 and tester_r 0 2024-04-25T12:50:31.450 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:50:37.551 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:50:37.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:37.552 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-25T12:50:37.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:37.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 Processor -- start 2024-04-25T12:50:37.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 -- start start 2024-04-25T12:50:37.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0bc81557e0 0x7f0bc80cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bc80cc730 0x7f0bc80cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bc815ed80 con 0x7f0bc806c9c0 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc80cb5a0 con 0x7f0bc80cc730 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.755+0000 7f0bced15640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0bc815f060 con 0x7f0bc81557e0 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bc80cc730 0x7f0bc80cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bc80cc730 0x7f0bc80cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60350/0 (socket says 172.21.15.132:60350) 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bcd2b2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0bc806c9c0 0x7f0bc806ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56026/0 (socket says 172.21.15.132:56026) 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 -- 172.21.15.132:0/1170521976 learned_addr learned my addr 172.21.15.132:0/1170521976 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bccab1640 1 --2- 172.21.15.132:0/1170521976 >> v2:172.21.15.157:3300/0 conn(0x7f0bc81557e0 0x7f0bc80cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 -- 172.21.15.132:0/1170521976 >> v2:172.21.15.157:3300/0 conn(0x7f0bc81557e0 msgr2=0x7f0bc80cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:37.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 --2- 172.21.15.132:0/1170521976 >> v2:172.21.15.157:3300/0 conn(0x7f0bc81557e0 0x7f0bc80cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 -- 172.21.15.132:0/1170521976 >> v1:172.21.15.132:6789/0 conn(0x7f0bc806c9c0 legacy=0x7f0bc806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc7fff640 1 -- 172.21.15.132:0/1170521976 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc815f340 con 0x7f0bc80cc730 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.756+0000 7f0bc77fe640 1 -- 172.21.15.132:0/1170521976 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725693615 0 0) 0x7f0bc815ed80 con 0x7f0bc806c9c0 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bc7fff640 1 --2- 172.21.15.132:0/1170521976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc80cbf70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bc808e6d0 tx=0x7f0bb402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2526f5c3b0fcf6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bc77fe640 1 -- 172.21.15.132:0/1170521976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4037070 con 0x7f0bc80cc730 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bc77fe640 1 -- 172.21.15.132:0/1170521976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb4032440 con 0x7f0bc80cc730 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bc77fe640 1 -- 172.21.15.132:0/1170521976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4032810 con 0x7f0bc80cc730 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 -- 172.21.15.132:0/1170521976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 msgr2=0x7f0bc80cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 --2- 172.21.15.132:0/1170521976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc80cbf70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0bc808e6d0 tx=0x7f0bb402a270 comp rx=0 tx=0).stop 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 -- 172.21.15.132:0/1170521976 shutdown_connections 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 --2- 172.21.15.132:0/1170521976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc80cbf70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 --2- 172.21.15.132:0/1170521976 >> v2:172.21.15.157:3300/0 conn(0x7f0bc81557e0 0x7f0bc80cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 -- 172.21.15.132:0/1170521976 >> 172.21.15.132:0/1170521976 conn(0x7f0bc80d0e10 msgr2=0x7f0bc80d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 -- 172.21.15.132:0/1170521976 shutdown_connections 2024-04-25T12:50:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.757+0000 7f0bced15640 1 -- 172.21.15.132:0/1170521976 wait complete. 2024-04-25T12:50:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 Processor -- start 2024-04-25T12:50:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 -- start start 2024-04-25T12:50:37.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc806c9c0 0x7f0bc8154640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc81f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc81557e0 0x7f0bc81f12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc80cd0c0 con 0x7f0bc80cc730 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc806d560 con 0x7f0bc806c9c0 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.759+0000 7f0bced15640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0bc80cd240 con 0x7f0bc81557e0 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc81f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc81f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60366/0 (socket says 172.21.15.132:60366) 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 -- 172.21.15.132:0/501163501 learned_addr learned my addr 172.21.15.132:0/501163501 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bccab1640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc806c9c0 0x7f0bc8154640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bcd2b2640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc81557e0 0x7f0bc81f12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:37.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 -- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc81557e0 msgr2=0x7f0bc81f12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc81557e0 0x7f0bc81f12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 -- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc806c9c0 msgr2=0x7f0bc8154640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc806c9c0 0x7f0bc8154640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 -- 172.21.15.132:0/501163501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc814d280 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bcd2b2640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc81557e0 0x7f0bc81f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc7fff640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc81f0d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0bb402a2b0 tx=0x7f0bb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4041020 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0bb40306c0 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc81f4a50 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4037040 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.760+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc8156c90 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.761+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc8068c20 con 0x7f0bc80cc730 2024-04-25T12:50:37.763 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.762+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0bb4044020 con 0x7f0bc80cc730 2024-04-25T12:50:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.762+0000 7f0bc57fa640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0bac06c8f0 0x7f0bac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.762+0000 7f0bccab1640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0bac06c8f0 0x7f0bac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.762+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0bb40ac710 con 0x7f0bc80cc730 2024-04-25T12:50:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.763+0000 7f0bccab1640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0bac06c8f0 0x7f0bac06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc006fd0 tx=0x7f0bbc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.767+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0bb404b030 con 0x7f0bc80cc730 2024-04-25T12:50:37.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.941+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0bc8151f40 con 0x7f0bc80cc730 2024-04-25T12:50:37.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.942+0000 7f0bc57fa640 1 -- 172.21.15.132:0/501163501 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f0bb407a800 con 0x7f0bc80cc730 2024-04-25T12:50:37.941 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:37.941 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:37.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0bac06c8f0 msgr2=0x7f0bac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:37.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0bac06c8f0 0x7f0bac06edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0bbc006fd0 tx=0x7f0bbc008040 comp rx=0 tx=0).stop 2024-04-25T12:50:37.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 msgr2=0x7f0bc81f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:37.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc81f0d60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0bb402a2b0 tx=0x7f0bb40046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 shutdown_connections 2024-04-25T12:50:37.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0bac06c8f0 0x7f0bac06edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0bc81557e0 0x7f0bc81f12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bc80cc730 0x7f0bc81f0d60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 --2- 172.21.15.132:0/501163501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0bc806c9c0 0x7f0bc8154640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:37.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 >> 172.21.15.132:0/501163501 conn(0x7f0bc80d0e10 msgr2=0x7f0bc8153a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:37.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 shutdown_connections 2024-04-25T12:50:37.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:37.944+0000 7f0bced15640 1 -- 172.21.15.132:0/501163501 wait complete. 2024-04-25T12:50:37.953 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:38.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.051+0000 7f7b801fe640 1 Processor -- start 2024-04-25T12:50:38.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.051+0000 7f7b801fe640 1 -- start start 2024-04-25T12:50:38.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b801fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b7815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b801fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b78159000 0x7f7b780c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b801fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7b78073890 0x7f7b780c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b801fe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7b780c6220 con 0x7f7b78159000 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b801fe640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7b78159440 con 0x7f7b78073890 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b801fe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b78153750 con 0x7f7b78153370 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b7d799640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b78159000 0x7f7b780c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b7d799640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b78159000 0x7f7b780c5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60368/0 (socket says 172.21.15.132:60368) 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b7d799640 1 -- 172.21.15.132:0/2551516451 learned_addr learned my addr 172.21.15.132:0/2551516451 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b7e79b640 1 --2- 172.21.15.132:0/2551516451 >> v2:172.21.15.157:3300/0 conn(0x7f7b78073890 0x7f7b780c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.052+0000 7f7b7df9a640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b7815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7d799640 1 -- 172.21.15.132:0/2551516451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 msgr2=0x7f7b7815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7d799640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b7815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7d799640 1 -- 172.21.15.132:0/2551516451 >> v2:172.21.15.157:3300/0 conn(0x7f7b78073890 msgr2=0x7f7b780c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7d799640 1 --2- 172.21.15.132:0/2551516451 >> v2:172.21.15.157:3300/0 conn(0x7f7b78073890 0x7f7b780c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.052 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7d799640 1 -- 172.21.15.132:0/2551516451 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b780c64b0 con 0x7f7b78159000 2024-04-25T12:50:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7df9a640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b7815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7d799640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78159000 0x7f7b780c5ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b780731c0 tx=0x7f7b6c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c88bb31f75173d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7cf98640 1 -- 172.21.15.132:0/2551516451 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c037070 con 0x7f7b78159000 2024-04-25T12:50:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7cf98640 1 -- 172.21.15.132:0/2551516451 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6c032440 con 0x7f7b78159000 2024-04-25T12:50:38.053 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.053+0000 7f7b7cf98640 1 -- 172.21.15.132:0/2551516451 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6c032810 con 0x7f7b78159000 2024-04-25T12:50:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 -- 172.21.15.132:0/2551516451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78159000 msgr2=0x7f7b780c5ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78159000 0x7f7b780c5ce0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f7b780731c0 tx=0x7f7b6c02a1e0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 -- 172.21.15.132:0/2551516451 shutdown_connections 2024-04-25T12:50:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78159000 0x7f7b780c5ce0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 --2- 172.21.15.132:0/2551516451 >> v2:172.21.15.157:3300/0 conn(0x7f7b78073890 0x7f7b780c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 --2- 172.21.15.132:0/2551516451 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b7815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 -- 172.21.15.132:0/2551516451 >> 172.21.15.132:0/2551516451 conn(0x7f7b78070970 msgr2=0x7f7b78070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 -- 172.21.15.132:0/2551516451 shutdown_connections 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.054+0000 7f7b801fe640 1 -- 172.21.15.132:0/2551516451 wait complete. 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.055+0000 7f7b801fe640 1 Processor -- start 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.055+0000 7f7b801fe640 1 -- start start 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 0x7f7b7814d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b781e30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b78159000 0x7f7b781e35f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7b7815c690 con 0x7f7b78073890 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7b780c6a70 con 0x7f7b78159000 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b7815c970 con 0x7f7b78153370 2024-04-25T12:50:38.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 0x7f7b7814d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 0x7f7b7814d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60380/0 (socket says 172.21.15.132:60380) 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 -- 172.21.15.132:0/1668523381 learned_addr learned my addr 172.21.15.132:0/1668523381 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7d799640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b781e30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7e79b640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b78159000 0x7f7b781e35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 -- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 msgr2=0x7f7b781e30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b781e30b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 -- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b78159000 msgr2=0x7f7b781e35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b78159000 0x7f7b781e35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 -- 172.21.15.132:0/1668523381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b7814de10 con 0x7f7b78073890 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7e79b640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b78159000 0x7f7b781e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b7df9a640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 0x7f7b7814d8d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800e760 tx=0x7f7b6800ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800f040 con 0x7f7b78073890 2024-04-25T12:50:38.058 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b68004230 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b781ef4a0 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6800ee70 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.056+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b781ef770 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.057+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b780741e0 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.058+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b6800c6d0 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.058+0000 7f7b767fc640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b6406c8f0 0x7f7b6406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.058+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7b6808bac0 con 0x7f7b78073890 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.058+0000 7f7b7d799640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b6406c8f0 0x7f7b6406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.059 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.059+0000 7f7b7d799640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b6406c8f0 0x7f7b6406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c034000 tx=0x7f7b6c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:38.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.062+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b68017020 con 0x7f7b78073890 2024-04-25T12:50:38.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.237+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7b7814eac0 con 0x7f7b78073890 2024-04-25T12:50:38.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.238+0000 7f7b767fc640 1 -- 172.21.15.132:0/1668523381 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f7b68059560 con 0x7f7b78073890 2024-04-25T12:50:38.236 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:38.236 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:38.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b6406c8f0 msgr2=0x7f7b6406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b6406c8f0 0x7f7b6406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c034000 tx=0x7f7b6c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:38.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 msgr2=0x7f7b7814d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 0x7f7b7814d8d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f7b6800e760 tx=0x7f7b6800ec20 comp rx=0 tx=0).stop 2024-04-25T12:50:38.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 shutdown_connections 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b6406c8f0 0x7f7b6406edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b78159000 0x7f7b781e35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b78153370 0x7f7b781e30b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 --2- 172.21.15.132:0/1668523381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b78073890 0x7f7b7814d8d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 >> 172.21.15.132:0/1668523381 conn(0x7f7b78070970 msgr2=0x7f7b780cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 shutdown_connections 2024-04-25T12:50:38.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.240+0000 7f7b801fe640 1 -- 172.21.15.132:0/1668523381 wait complete. 2024-04-25T12:50:38.249 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T12:50:38.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.351+0000 7fa0e3605640 1 Processor -- start 2024-04-25T12:50:38.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.351+0000 7fa0e3605640 1 -- start start 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e3605640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc144550 0x7fa0dc0cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e3605640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0dc072ea0 0x7fa0dc073330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e3605640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0dc0c9cd0 con 0x7fa0dc15e920 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e3605640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fa0dc15b330 con 0x7fa0dc072ea0 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e3605640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc15ee10 con 0x7fa0dc144550 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e1ba2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa0dc072ea0 0x7fa0dc073330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e0ba0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa0dc15e920 0x7fa0dc15bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56036/0 (socket says 172.21.15.132:56036) 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e1ba2640 1 --2- 172.21.15.132:0/1482923452 >> v2:172.21.15.132:3300/0 conn(0x7fa0dc072ea0 0x7fa0dc073330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60382/0 (socket says 172.21.15.132:60382) 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e0ba0640 1 -- 172.21.15.132:0/1482923452 learned_addr learned my addr 172.21.15.132:0/1482923452 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e13a1640 1 --2- 172.21.15.132:0/1482923452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc144550 0x7fa0dc0cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e1ba2640 1 -- 172.21.15.132:0/1482923452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc144550 msgr2=0x7fa0dc0cba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e1ba2640 1 --2- 172.21.15.132:0/1482923452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc144550 0x7fa0dc0cba40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e1ba2640 1 -- 172.21.15.132:0/1482923452 >> v1:172.21.15.132:6789/0 conn(0x7fa0dc15e920 legacy=0x7fa0dc15bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0e1ba2640 1 -- 172.21.15.132:0/1482923452 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc15f0f0 con 0x7fa0dc072ea0 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.352+0000 7fa0d3fff640 1 -- 172.21.15.132:0/1482923452 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1176200306 0 0) 0x7fa0dc0c9cd0 con 0x7fa0dc15e920 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.353+0000 7fa0e1ba2640 1 --2- 172.21.15.132:0/1482923452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc073330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097a0 tx=0x7fa0d802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e171a38d518e2724 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.353+0000 7fa0d3fff640 1 -- 172.21.15.132:0/1482923452 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8037070 con 0x7fa0dc072ea0 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.353+0000 7fa0d3fff640 1 -- 172.21.15.132:0/1482923452 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0d8032440 con 0x7fa0dc072ea0 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.353+0000 7fa0d3fff640 1 -- 172.21.15.132:0/1482923452 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8032810 con 0x7fa0dc072ea0 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 -- 172.21.15.132:0/1482923452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc072ea0 msgr2=0x7fa0dc073330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 --2- 172.21.15.132:0/1482923452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc073330 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fa0d80097a0 tx=0x7fa0d802a180 comp rx=0 tx=0).stop 2024-04-25T12:50:38.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 -- 172.21.15.132:0/1482923452 shutdown_connections 2024-04-25T12:50:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 --2- 172.21.15.132:0/1482923452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc073330 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 --2- 172.21.15.132:0/1482923452 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc144550 0x7fa0dc0cba40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 -- 172.21.15.132:0/1482923452 >> 172.21.15.132:0/1482923452 conn(0x7fa0dc070a90 msgr2=0x7fa0dc070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 -- 172.21.15.132:0/1482923452 shutdown_connections 2024-04-25T12:50:38.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.354+0000 7fa0e3605640 1 -- 172.21.15.132:0/1482923452 wait complete. 2024-04-25T12:50:38.356 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.355+0000 7fa0e3605640 1 Processor -- start 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.355+0000 7fa0e3605640 1 -- start start 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc0c8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 0x7fa0dc0c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc15e920 0x7fa0dc0cea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc15b5f0 con 0x7fa0dc144550 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa0dc15f6b0 con 0x7fa0dc072ea0 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa0dc15c220 con 0x7fa0dc15e920 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 0x7fa0dc0c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 0x7fa0dc0c62a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60396/0 (socket says 172.21.15.132:60396) 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 -- 172.21.15.132:0/466982821 learned_addr learned my addr 172.21.15.132:0/466982821 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e13a1640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc0c8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e1ba2640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc15e920 0x7fa0dc0cea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 -- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc15e920 msgr2=0x7fa0dc0cea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc15e920 0x7fa0dc0cea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 -- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0dc072ea0 msgr2=0x7fa0dc0c8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc0c8450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 -- 172.21.15.132:0/466982821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0dc1f1a60 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e13a1640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e0ba0640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 0x7fa0dc0c62a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c500 tx=0x7fa0cc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc018070 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa0cc007580 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0dc13de30 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.356+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0cc004a20 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.357+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0dc13e3f0 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.357+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0dc073650 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.358+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa0cc01b070 con 0x7fa0dc144550 2024-04-25T12:50:38.358 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.358+0000 7fa0d1ffb640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa0c006c920 0x7fa0c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:38.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.358+0000 7fa0e13a1640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa0c006c920 0x7fa0c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:38.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.358+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa0cc08b0b0 con 0x7fa0dc144550 2024-04-25T12:50:38.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.359+0000 7fa0e13a1640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa0c006c920 0x7fa0c006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40074c0 tx=0x7fa0d400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:38.360 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.363+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa0dc073650 con 0x7fa0dc144550 2024-04-25T12:50:38.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:38.573+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fa0dc068d00 con 0x7fa0dc144550 2024-04-25T12:50:39.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.420+0000 7fa0d1ffb640 1 -- 172.21.15.132:0/466982821 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fa0cc059230 con 0x7fa0dc144550 2024-04-25T12:50:39.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa0c006c920 msgr2=0x7fa0c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:39.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa0c006c920 0x7fa0c006ede0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40074c0 tx=0x7fa0d400b040 comp rx=0 tx=0).stop 2024-04-25T12:50:39.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 msgr2=0x7fa0dc0c62a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:39.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 0x7fa0dc0c62a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fa0cc00c500 tx=0x7fa0cc00c9c0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 shutdown_connections 2024-04-25T12:50:39.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa0c006c920 0x7fa0c006ede0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.423+0000 7fa0e3605640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa0dc15e920 0x7fa0dc0cea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.424+0000 7fa0e3605640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0dc144550 0x7fa0dc0c62a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.424+0000 7fa0e3605640 1 --2- 172.21.15.132:0/466982821 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa0dc072ea0 0x7fa0dc0c8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.424+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 >> 172.21.15.132:0/466982821 conn(0x7fa0dc070a90 msgr2=0x7fa0dc0c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:39.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.424+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 shutdown_connections 2024-04-25T12:50:39.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.424+0000 7fa0e3605640 1 -- 172.21.15.132:0/466982821 wait complete. 2024-04-25T12:50:39.435 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'session_timeout': 300} 2024-04-25T12:50:39.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T12:50:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.543+0000 7fb555344640 1 Processor -- start 2024-04-25T12:50:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.543+0000 7fb555344640 1 -- start start 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb555344640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb550155380 0x7fb5500c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb555344640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb55015eed0 0x7fb5500c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb555344640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5500cbef0 con 0x7fb5500cdfe0 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb555344640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb5500d08a0 con 0x7fb550155380 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb555344640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb5500d0af0 con 0x7fb55015eed0 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb550155380 0x7fb5500c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:39.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb5500cdfe0 0x7fb55015e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56040/0 (socket says 172.21.15.132:56040) 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54e7fc640 1 -- 172.21.15.132:0/3607915938 learned_addr learned my addr 172.21.15.132:0/3607915938 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54f7fe640 1 --2- 172.21.15.132:0/3607915938 >> v2:172.21.15.157:3300/0 conn(0x7fb55015eed0 0x7fb5500c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54effd640 1 -- 172.21.15.132:0/3607915938 >> v2:172.21.15.157:3300/0 conn(0x7fb55015eed0 msgr2=0x7fb5500c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54effd640 1 --2- 172.21.15.132:0/3607915938 >> v2:172.21.15.157:3300/0 conn(0x7fb55015eed0 0x7fb5500c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54effd640 1 -- 172.21.15.132:0/3607915938 >> v1:172.21.15.132:6789/0 conn(0x7fb5500cdfe0 legacy=0x7fb55015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54effd640 1 -- 172.21.15.132:0/3607915938 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5500d0dd0 con 0x7fb550155380 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.544+0000 7fb54dffb640 1 -- 172.21.15.132:0/3607915938 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 491834719 0 0) 0x7fb5500cbef0 con 0x7fb5500cdfe0 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.545+0000 7fb54effd640 1 --2- 172.21.15.132:0/3607915938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550155380 0x7fb5500c6260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5500ce430 tx=0x7fb54002a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d86b5001f8f9950f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.545+0000 7fb54dffb640 1 -- 172.21.15.132:0/3607915938 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540007740 con 0x7fb550155380 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.545+0000 7fb54dffb640 1 -- 172.21.15.132:0/3607915938 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5400078e0 con 0x7fb550155380 2024-04-25T12:50:39.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.545+0000 7fb54dffb640 1 -- 172.21.15.132:0/3607915938 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb540007cb0 con 0x7fb550155380 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 -- 172.21.15.132:0/3607915938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550155380 msgr2=0x7fb5500c6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 --2- 172.21.15.132:0/3607915938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550155380 0x7fb5500c6260 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fb5500ce430 tx=0x7fb54002a710 comp rx=0 tx=0).stop 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 -- 172.21.15.132:0/3607915938 shutdown_connections 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 --2- 172.21.15.132:0/3607915938 >> v2:172.21.15.157:3300/0 conn(0x7fb55015eed0 0x7fb5500c67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 --2- 172.21.15.132:0/3607915938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550155380 0x7fb5500c6260 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 -- 172.21.15.132:0/3607915938 >> 172.21.15.132:0/3607915938 conn(0x7fb55006c030 msgr2=0x7fb55006c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 -- 172.21.15.132:0/3607915938 shutdown_connections 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.546+0000 7fb555344640 1 -- 172.21.15.132:0/3607915938 wait complete. 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.547+0000 7fb555344640 1 Processor -- start 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.547+0000 7fb555344640 1 -- start start 2024-04-25T12:50:39.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5500cdfe0 0x7fb550149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb550155380 0x7fb550158ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 0x7fb550144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb5501558e0 con 0x7fb550159530 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb550155760 con 0x7fb5500cdfe0 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb5500cb2b0 con 0x7fb550155380 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 0x7fb550144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 0x7fb550144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60416/0 (socket says 172.21.15.132:60416) 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 -- 172.21.15.132:0/1493360924 learned_addr learned my addr 172.21.15.132:0/1493360924 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54effd640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5500cdfe0 0x7fb550149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 -- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb550155380 msgr2=0x7fb550158ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54e7fc640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb550155380 0x7fb550158ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb550155380 0x7fb550158ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 -- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5500cdfe0 msgr2=0x7fb550149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:39.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5500cdfe0 0x7fb550149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 -- 172.21.15.132:0/1493360924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb55014aa90 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54effd640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5500cdfe0 0x7fb550149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54e7fc640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb550155380 0x7fb550158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb54f7fe640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 0x7fb550144810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb54800e7f0 tx=0x7fb54800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb548017070 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb54800c730 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb55014bac0 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb54800cb20 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.548+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb55015c940 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.549+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb550068d00 con 0x7fb550159530 2024-04-25T12:50:39.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.550+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb54801a070 con 0x7fb550159530 2024-04-25T12:50:39.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.550+0000 7fb5377fe640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb53c06c8f0 0x7fb53c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:39.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.550+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb54808bd60 con 0x7fb550159530 2024-04-25T12:50:39.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.550+0000 7fb54effd640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb53c06c8f0 0x7fb53c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:39.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.551+0000 7fb54effd640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb53c06c8f0 0x7fb53c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb540034000 tx=0x7fb54002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:39.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.555+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb548059dc0 con 0x7fb550159530 2024-04-25T12:50:39.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:39.766+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb5500cad60 con 0x7fb550159530 2024-04-25T12:50:40.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:50:40.109 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:50:40.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.421+0000 7fb5377fe640 1 -- 172.21.15.132:0/1493360924 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7fb5480596c0 con 0x7fb550159530 2024-04-25T12:50:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb53c06c8f0 msgr2=0x7fb53c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb53c06c8f0 0x7fb53c06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb540034000 tx=0x7fb54002f000 comp rx=0 tx=0).stop 2024-04-25T12:50:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 msgr2=0x7fb550144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 0x7fb550144810 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb54800e7f0 tx=0x7fb54800ecb0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 shutdown_connections 2024-04-25T12:50:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb53c06c8f0 0x7fb53c06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb550159530 0x7fb550144810 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb550155380 0x7fb550158ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 --2- 172.21.15.132:0/1493360924 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb5500cdfe0 0x7fb550149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 >> 172.21.15.132:0/1493360924 conn(0x7fb55006c030 msgr2=0x7fb55014d5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 shutdown_connections 2024-04-25T12:50:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.424+0000 7fb555344640 1 -- 172.21.15.132:0/1493360924 wait complete. 2024-04-25T12:50:40.434 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-25T12:50:40.536 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.538+0000 7fc65e210640 1 Processor -- start 2024-04-25T12:50:40.537 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.538+0000 7fc65e210640 1 -- start start 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc65e210640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc658158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc65e210640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6580c5fd0 0x7fc6580c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc65e210640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6580c6980 con 0x7fc658152010 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc65e210640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc6580c5b40 con 0x7fc6580c5fd0 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc65e210640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6580c56f0 con 0x7fc6580c8670 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc657fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc6580c5fd0 0x7fc6580c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc658158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc656ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc658158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:48512/0 (socket says 172.21.15.132:48512) 2024-04-25T12:50:40.538 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc6577fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fc658152010 0x7fc6580cc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:37382/0 (socket says 172.21.15.132:37382) 2024-04-25T12:50:40.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.539+0000 7fc656ffd640 1 -- 172.21.15.132:0/2823130755 learned_addr learned my addr 172.21.15.132:0/2823130755 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:40.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.540+0000 7fc656ffd640 1 -- 172.21.15.132:0/2823130755 >> v2:172.21.15.157:3300/0 conn(0x7fc6580c5fd0 msgr2=0x7fc6580c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:40.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.540+0000 7fc656ffd640 1 --2- 172.21.15.132:0/2823130755 >> v2:172.21.15.157:3300/0 conn(0x7fc6580c5fd0 0x7fc6580c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.540+0000 7fc656ffd640 1 -- 172.21.15.132:0/2823130755 >> v1:172.21.15.157:6789/0 conn(0x7fc658152010 legacy=0x7fc6580cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:40.539 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.540+0000 7fc656ffd640 1 -- 172.21.15.132:0/2823130755 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6580c4b70 con 0x7fc6580c8670 2024-04-25T12:50:40.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc656ffd640 1 --2- 172.21.15.132:0/2823130755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc658158880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00bb10 tx=0x7fc64c02c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ecd23d200a10d04e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:40.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc6567fc640 1 -- 172.21.15.132:0/2823130755 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c036020 con 0x7fc6580c8670 2024-04-25T12:50:40.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc6567fc640 1 -- 172.21.15.132:0/2823130755 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64c032820 con 0x7fc6580c8670 2024-04-25T12:50:40.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc6567fc640 1 -- 172.21.15.132:0/2823130755 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64c032bf0 con 0x7fc6580c8670 2024-04-25T12:50:40.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 -- 172.21.15.132:0/2823130755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 msgr2=0x7fc658158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:40.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 --2- 172.21.15.132:0/2823130755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc658158880 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fc64c00bb10 tx=0x7fc64c02c920 comp rx=0 tx=0).stop 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 -- 172.21.15.132:0/2823130755 shutdown_connections 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 --2- 172.21.15.132:0/2823130755 >> v2:172.21.15.157:3300/0 conn(0x7fc6580c5fd0 0x7fc6580c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 --2- 172.21.15.132:0/2823130755 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc658158880 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 -- 172.21.15.132:0/2823130755 >> 172.21.15.132:0/2823130755 conn(0x7fc658075db0 msgr2=0x7fc658067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 -- 172.21.15.132:0/2823130755 shutdown_connections 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.541+0000 7fc65e210640 1 -- 172.21.15.132:0/2823130755 wait complete. 2024-04-25T12:50:40.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.542+0000 7fc65e210640 1 Processor -- start 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 -- start start 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6580c5fd0 0x7fc658073840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc6581f1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 0x7fc6581f1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580c5410 con 0x7fc658152010 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc6580c5130 con 0x7fc6580c5fd0 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc65e210640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc6580c3ae0 con 0x7fc6580c8670 2024-04-25T12:50:40.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc657fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 0x7fc6581f1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc657fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 0x7fc6581f1870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60422/0 (socket says 172.21.15.132:60422) 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc657fff640 1 -- 172.21.15.132:0/1310007468 learned_addr learned my addr 172.21.15.132:0/1310007468 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc6577fe640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6580c5fd0 0x7fc658073840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.543+0000 7fc656ffd640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc6581f1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc657fff640 1 -- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 msgr2=0x7fc6581f1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc657fff640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc6581f1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc657fff640 1 -- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6580c5fd0 msgr2=0x7fc658073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc657fff640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6580c5fd0 0x7fc658073840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc657fff640 1 -- 172.21.15.132:0/1310007468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6581f4a90 con 0x7fc658152010 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc657fff640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 0x7fc6581f1870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc65000efc0 tx=0x7fc65000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650018020 con 0x7fc658152010 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc650014480 con 0x7fc658152010 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc65814cc50 con 0x7fc658152010 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc650014870 con 0x7fc658152010 2024-04-25T12:50:40.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.544+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc65814d210 con 0x7fc658152010 2024-04-25T12:50:40.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.545+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc658068d00 con 0x7fc658152010 2024-04-25T12:50:40.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.545+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc650005d10 con 0x7fc658152010 2024-04-25T12:50:40.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.546+0000 7fc63ffff640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc64406c8f0 0x7fc64406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:40.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.546+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc65008cbd0 con 0x7fc658152010 2024-04-25T12:50:40.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.546+0000 7fc6577fe640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc64406c8f0 0x7fc64406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:40.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.546+0000 7fc6577fe640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc64406c8f0 0x7fc64406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc648007fd0 tx=0x7fc648007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:40.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.550+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc650022030 con 0x7fc658152010 2024-04-25T12:50:40.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:40.763+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fc6580c94f0 con 0x7fc658152010 2024-04-25T12:50:41.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.429+0000 7fc63ffff640 1 -- 172.21.15.132:0/1310007468 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v9) ==== 115+0+0 (secure 0 0 0) 0x7fc650010040 con 0x7fc658152010 2024-04-25T12:50:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc64406c8f0 msgr2=0x7fc64406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc64406c8f0 0x7fc64406edb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc648007fd0 tx=0x7fc648007e80 comp rx=0 tx=0).stop 2024-04-25T12:50:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 msgr2=0x7fc6581f1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 0x7fc6581f1870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc65000efc0 tx=0x7fc65000c490 comp rx=0 tx=0).stop 2024-04-25T12:50:41.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 shutdown_connections 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc64406c8f0 0x7fc64406edb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc658152010 0x7fc6581f1870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc6580c8670 0x7fc6581f1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 --2- 172.21.15.132:0/1310007468 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc6580c5fd0 0x7fc658073840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 >> 172.21.15.132:0/1310007468 conn(0x7fc658075db0 msgr2=0x7fc6580c7830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 shutdown_connections 2024-04-25T12:50:41.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.432+0000 7fc65e210640 1 -- 172.21.15.132:0/1310007468 wait complete. 2024-04-25T12:50:41.443 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T12:50:41.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:41.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.545+0000 7f601774f640 1 Processor -- start 2024-04-25T12:50:41.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.545+0000 7f601774f640 1 -- start start 2024-04-25T12:50:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f601774f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60100c8940 0x7f60100ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f601774f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60100c8d20 con 0x7f6010070870 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f601774f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f601015bb50 con 0x7f601015f350 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f601774f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f601015f7a0 con 0x7f60100c8940 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f60154eb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60100c8940 0x7f60100ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f6015cec640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6010070870 0x7f6010070c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56052/0 (socket says 172.21.15.132:56052) 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f6015cec640 1 -- 172.21.15.132:0/198427033 learned_addr learned my addr 172.21.15.132:0/198427033 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f60154eb640 1 -- 172.21.15.132:0/198427033 >> v1:172.21.15.157:6789/0 conn(0x7f601015f350 legacy=0x7f601015b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f60154eb640 1 -- 172.21.15.132:0/198427033 >> v1:172.21.15.132:6789/0 conn(0x7f6010070870 legacy=0x7f6010070c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f6007fff640 1 -- 172.21.15.132:0/198427033 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768195350 0 0) 0x7f60100c8d20 con 0x7f6010070870 2024-04-25T12:50:41.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.546+0000 7f60154eb640 1 -- 172.21.15.132:0/198427033 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601015be30 con 0x7f60100c8940 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.547+0000 7f60154eb640 1 --2- 172.21.15.132:0/198427033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60100c8940 0x7f60100ca200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f600c0097a0 tx=0x7f600c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6dded246cba254 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.547+0000 7f6007fff640 1 -- 172.21.15.132:0/198427033 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c037070 con 0x7f60100c8940 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.547+0000 7f6007fff640 1 -- 172.21.15.132:0/198427033 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600c02ae50 con 0x7f60100c8940 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.547+0000 7f6007fff640 1 -- 172.21.15.132:0/198427033 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c032660 con 0x7f60100c8940 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.547+0000 7f601774f640 1 -- 172.21.15.132:0/198427033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60100c8940 msgr2=0x7f60100ca200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.547+0000 7f601774f640 1 --2- 172.21.15.132:0/198427033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60100c8940 0x7f60100ca200 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f600c0097a0 tx=0x7f600c02a140 comp rx=0 tx=0).stop 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.548+0000 7f601774f640 1 -- 172.21.15.132:0/198427033 shutdown_connections 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.548+0000 7f601774f640 1 --2- 172.21.15.132:0/198427033 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60100c8940 0x7f60100ca200 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.548+0000 7f601774f640 1 -- 172.21.15.132:0/198427033 >> 172.21.15.132:0/198427033 conn(0x7f6010067630 msgr2=0x7f6010067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.548+0000 7f601774f640 1 -- 172.21.15.132:0/198427033 shutdown_connections 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.548+0000 7f601774f640 1 -- 172.21.15.132:0/198427033 wait complete. 2024-04-25T12:50:41.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 Processor -- start 2024-04-25T12:50:41.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 -- start start 2024-04-25T12:50:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6010070870 0x7f601015e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60100c8940 0x7f6010154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 0x7f60101566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f601015e870 con 0x7f601015f350 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f601015b8f0 con 0x7f6010070870 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f601774f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f601015eb50 con 0x7f60100c8940 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f6015cec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 0x7f60101566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.549+0000 7f6015cec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 0x7f60101566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60428/0 (socket says 172.21.15.132:60428) 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 -- 172.21.15.132:0/3058323556 learned_addr learned my addr 172.21.15.132:0/3058323556 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f60154eb640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6010070870 0x7f601015e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6014cea640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60100c8940 0x7f6010154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 -- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60100c8940 msgr2=0x7f6010154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60100c8940 0x7f6010154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 -- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6010070870 msgr2=0x7f601015e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6010070870 0x7f601015e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 -- 172.21.15.132:0/3058323556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6010158620 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f60154eb640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6010070870 0x7f601015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6015cec640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 0x7f60101566c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f600800c7a0 tx=0x7f600800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008018070 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f600800a640 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6010158ba0 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600800aab0 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.550+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601015ce50 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.551+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6010068c20 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.552+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f600801b070 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.552+0000 7f6005ffb640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5ff406c8f0 0x7f5ff406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.552+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f600808b510 con 0x7f601015f350 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.552+0000 7f60154eb640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5ff406c8f0 0x7f5ff406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.552+0000 7f60154eb640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5ff406c8f0 0x7f5ff406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f600c034000 tx=0x7f600c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:41.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.556+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6008059570 con 0x7f601015f350 2024-04-25T12:50:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.767+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60100c94a0 con 0x7f601015f350 2024-04-25T12:50:41.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.768+0000 7f6005ffb640 1 -- 172.21.15.132:0/3058323556 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6841 (secure 0 0 0) 0x7f6008058e70 con 0x7f601015f350 2024-04-25T12:50:41.766 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:41.766 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:40.764315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:50:41.766 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2024-04-25T12:50:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5ff406c8f0 msgr2=0x7f5ff406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5ff406c8f0 0x7f5ff406edb0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f600c034000 tx=0x7f600c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 msgr2=0x7f60101566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 0x7f60101566c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f600800c7a0 tx=0x7f600800cc60 comp rx=0 tx=0).stop 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 shutdown_connections 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f5ff406c8f0 0x7f5ff406edb0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f601015f350 0x7f60101566c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f60100c8940 0x7f6010154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 --2- 172.21.15.132:0/3058323556 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6010070870 0x7f601015e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 >> 172.21.15.132:0/3058323556 conn(0x7f6010067630 msgr2=0x7f60101e4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 shutdown_connections 2024-04-25T12:50:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.770+0000 7f601774f640 1 -- 172.21.15.132:0/3058323556 wait complete. 2024-04-25T12:50:41.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:41.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.878+0000 7feb643f0640 1 Processor -- start 2024-04-25T12:50:41.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.878+0000 7feb643f0640 1 -- start start 2024-04-25T12:50:41.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb643f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb5c14fa40 0x7feb5c0c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb643f0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c0c68a0 0x7feb5c0c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb643f0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb5c158f20 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb643f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7feb5c14fe20 con 0x7feb5c14fa40 2024-04-25T12:50:41.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb643f0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c1597f0 con 0x7feb5c0c68a0 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb5c14fa40 0x7feb5c0c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feb5c14fa40 0x7feb5c0c8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60432/0 (socket says 172.21.15.132:60432) 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 -- 172.21.15.132:0/2599729204 learned_addr learned my addr 172.21.15.132:0/2599729204 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6298d640 1 --2- 172.21.15.132:0/2599729204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c0c68a0 0x7feb5c0c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 -- 172.21.15.132:0/2599729204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c0c68a0 msgr2=0x7feb5c0c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 --2- 172.21.15.132:0/2599729204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c0c68a0 0x7feb5c0c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 -- 172.21.15.132:0/2599729204 >> v1:172.21.15.157:6789/0 conn(0x7feb5c0ca3f0 legacy=0x7feb5c06f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.879+0000 7feb6218c640 1 -- 172.21.15.132:0/2599729204 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c0c9620 con 0x7feb5c14fa40 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb6218c640 1 --2- 172.21.15.132:0/2599729204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c14fa40 0x7feb5c0c8d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb5802a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f41877e0946e54e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb6118a640 1 -- 172.21.15.132:0/2599729204 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58037070 con 0x7feb5c14fa40 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb6118a640 1 -- 172.21.15.132:0/2599729204 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb5802ae50 con 0x7feb5c14fa40 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb6118a640 1 -- 172.21.15.132:0/2599729204 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58032860 con 0x7feb5c14fa40 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb643f0640 1 -- 172.21.15.132:0/2599729204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c14fa40 msgr2=0x7feb5c0c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb643f0640 1 --2- 172.21.15.132:0/2599729204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c14fa40 0x7feb5c0c8d90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7feb58009870 tx=0x7feb5802a300 comp rx=0 tx=0).stop 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb643f0640 1 -- 172.21.15.132:0/2599729204 shutdown_connections 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb643f0640 1 --2- 172.21.15.132:0/2599729204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c0c68a0 0x7feb5c0c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb643f0640 1 --2- 172.21.15.132:0/2599729204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c14fa40 0x7feb5c0c8d90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.880+0000 7feb643f0640 1 -- 172.21.15.132:0/2599729204 >> 172.21.15.132:0/2599729204 conn(0x7feb5c06d770 msgr2=0x7feb5c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.881+0000 7feb643f0640 1 -- 172.21.15.132:0/2599729204 shutdown_connections 2024-04-25T12:50:41.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.881+0000 7feb643f0640 1 -- 172.21.15.132:0/2599729204 wait complete. 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 Processor -- start 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 -- start start 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb5c0c68a0 0x7feb5c1e4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 0x7feb5c1e2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c14fa40 0x7feb5c1ef420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c159480 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7feb5c1591a0 con 0x7feb5c0c68a0 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb643f0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7feb5c0c92d0 con 0x7feb5c14fa40 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb6198b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 0x7feb5c1e2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb6198b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 0x7feb5c1e2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60438/0 (socket says 172.21.15.132:60438) 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb6198b640 1 -- 172.21.15.132:0/3165771938 learned_addr learned my addr 172.21.15.132:0/3165771938 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.882+0000 7feb6218c640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb5c0c68a0 0x7feb5c1e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6298d640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c14fa40 0x7feb5c1ef420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6198b640 1 -- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c14fa40 msgr2=0x7feb5c1ef420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6198b640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c14fa40 0x7feb5c1ef420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6198b640 1 -- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb5c0c68a0 msgr2=0x7feb5c1e4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6198b640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb5c0c68a0 0x7feb5c1e4720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6198b640 1 -- 172.21.15.132:0/3165771938 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb5c1f2b30 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6218c640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb5c0c68a0 0x7feb5c1e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb6198b640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 0x7feb5c1e2b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c400 tx=0x7feb4c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c0052d0 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb4c005490 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb5c1f2dd0 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb4c007260 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.883+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb5c1e5520 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.884+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb5c156840 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.884+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb4c007400 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.885+0000 7feb52ffd640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb4006c920 0x7feb4006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:41.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.885+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7feb4c08b3a0 con 0x7feb5c0ca3f0 2024-04-25T12:50:41.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.885+0000 7feb6218c640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb4006c920 0x7feb4006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:41.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.885+0000 7feb6218c640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb4006c920 0x7feb4006ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb58034000 tx=0x7feb5802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:41.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:41.889+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feb5c158f20 con 0x7feb5c0ca3f0 2024-04-25T12:50:42.062 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.064+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb5c0cdd80 con 0x7feb5c0ca3f0 2024-04-25T12:50:42.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.065+0000 7feb52ffd640 1 -- 172.21.15.132:0/3165771938 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7feb4c059490 con 0x7feb5c0ca3f0 2024-04-25T12:50:42.064 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:42.064 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb4006c920 msgr2=0x7feb4006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb4006c920 0x7feb4006ede0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feb58034000 tx=0x7feb5802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 msgr2=0x7feb5c1e2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 0x7feb5c1e2b40 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7feb4c00c400 tx=0x7feb4c00c8c0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 shutdown_connections 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7feb4006c920 0x7feb4006ede0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7feb5c14fa40 0x7feb5c1ef420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb5c0ca3f0 0x7feb5c1e2b40 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 --2- 172.21.15.132:0/3165771938 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7feb5c0c68a0 0x7feb5c1e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.066 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.067+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 >> 172.21.15.132:0/3165771938 conn(0x7feb5c06d770 msgr2=0x7feb5c06db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:42.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.068+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 shutdown_connections 2024-04-25T12:50:42.067 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.068+0000 7feb643f0640 1 -- 172.21.15.132:0/3165771938 wait complete. 2024-04-25T12:50:42.077 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T12:50:42.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:42.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.175+0000 7f6760079640 1 Processor -- start 2024-04-25T12:50:42.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.175+0000 7f6760079640 1 -- start start 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f6760079640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f6760079640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6758073890 0x7f67580c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f6760079640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6758159440 con 0x7f6758159000 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f6760079640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6758153750 con 0x7f6758073890 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f6760079640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f67580c64b0 con 0x7f6758153370 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f675e616640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6758073890 0x7f67580c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.176 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f675e616640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6758073890 0x7f67580c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60450/0 (socket says 172.21.15.132:60450) 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f675e616640 1 -- 172.21.15.132:0/1611819151 learned_addr learned my addr 172.21.15.132:0/1611819151 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.176+0000 7f675de15640 1 --2- 172.21.15.132:0/1611819151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675e616640 1 -- 172.21.15.132:0/1611819151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 msgr2=0x7f675815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675e616640 1 --2- 172.21.15.132:0/1611819151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675e616640 1 -- 172.21.15.132:0/1611819151 >> v1:172.21.15.157:6789/0 conn(0x7f6758159000 legacy=0x7f67580c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675e616640 1 -- 172.21.15.132:0/1611819151 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67580c6790 con 0x7f6758073890 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675e616640 1 --2- 172.21.15.132:0/1611819151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758073890 0x7f67580c80e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6750009870 tx=0x7f675002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d6e74ee47c49ac1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675ce13640 1 -- 172.21.15.132:0/1611819151 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750037070 con 0x7f6758073890 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.177+0000 7f675ce13640 1 -- 172.21.15.132:0/1611819151 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6750032440 con 0x7f6758073890 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f675ce13640 1 -- 172.21.15.132:0/1611819151 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750032810 con 0x7f6758073890 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 -- 172.21.15.132:0/1611819151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758073890 msgr2=0x7f67580c80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 --2- 172.21.15.132:0/1611819151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758073890 0x7f67580c80e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6750009870 tx=0x7f675002a270 comp rx=0 tx=0).stop 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 -- 172.21.15.132:0/1611819151 shutdown_connections 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 --2- 172.21.15.132:0/1611819151 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758073890 0x7f67580c80e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 --2- 172.21.15.132:0/1611819151 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 -- 172.21.15.132:0/1611819151 >> 172.21.15.132:0/1611819151 conn(0x7f6758070970 msgr2=0x7f6758070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:42.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 -- 172.21.15.132:0/1611819151 shutdown_connections 2024-04-25T12:50:42.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.178+0000 7f6760079640 1 -- 172.21.15.132:0/1611819151 wait complete. 2024-04-25T12:50:42.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.179+0000 7f6760079640 1 Processor -- start 2024-04-25T12:50:42.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.179+0000 7f6760079640 1 -- start start 2024-04-25T12:50:42.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f6760079640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6758073890 0x7f675815b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f6760079640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f6760079640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 0x7f67581e5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f6760079640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f675815c970 con 0x7f6758159000 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f6760079640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f675815c690 con 0x7f6758073890 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f6760079640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f675815cc50 con 0x7f6758153370 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 0x7f67581e5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 0x7f67581e5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60462/0 (socket says 172.21.15.132:60462) 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 -- 172.21.15.132:0/3924648156 learned_addr learned my addr 172.21.15.132:0/3924648156 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675de15640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6758073890 0x7f675815b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675d614640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 -- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 msgr2=0x7f675815bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 -- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6758073890 msgr2=0x7f675815b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6758073890 0x7f675815b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 -- 172.21.15.132:0/3924648156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f675814c710 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.180+0000 7f675e616640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 0x7f67581e5860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6750009870 tx=0x7f67500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.181+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750041020 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.181+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f675003d640 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.181+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6750037040 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.181+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67580cdb90 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.181+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f675815afa0 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.182+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6758070460 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.182+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6750044020 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.182+0000 7f674e7fc640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f673c06c8f0 0x7f673c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.182+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f67500ac450 con 0x7f6758159000 2024-04-25T12:50:42.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.182+0000 7f675de15640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f673c06c8f0 0x7f673c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.183+0000 7f675de15640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f673c06c8f0 0x7f673c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67540113e0 tx=0x7f675400b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.187+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6758070460 con 0x7f6758159000 2024-04-25T12:50:42.357 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.358+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f675814ec10 con 0x7f673c06c8f0 2024-04-25T12:50:42.364 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.367+0000 7f674e7fc640 1 -- 172.21.15.132:0/3924648156 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f6754003990 con 0x7f673c06c8f0 2024-04-25T12:50:42.369 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:42.370 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f673c06c8f0 msgr2=0x7f673c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f673c06c8f0 0x7f673c06edb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67540113e0 tx=0x7f675400b040 comp rx=0 tx=0).stop 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 msgr2=0x7f67581e5860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 0x7f67581e5860 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6750009870 tx=0x7f67500046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 shutdown_connections 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f673c06c8f0 0x7f673c06edb0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6758159000 0x7f67581e5860 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.372 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6758153370 0x7f675815bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 --2- 172.21.15.132:0/3924648156 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6758073890 0x7f675815b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 >> 172.21.15.132:0/3924648156 conn(0x7f6758070970 msgr2=0x7f6758070d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 shutdown_connections 2024-04-25T12:50:42.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.370+0000 7f6760079640 1 -- 172.21.15.132:0/3924648156 wait complete. 2024-04-25T12:50:42.379 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T12:50:41.133207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231920,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742800,"statfs":{"total":773094113280,"available":772856627200,"internally_reserved":0,"allocated":3350528,"data_stored":2024952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003126"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490836+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:18.490836+0000","last_peered":"2024-04-25T12:50:18.490836+0000","last_clean":"2024-04-25T12:50:18.490836+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:18.490836+0000","last_undegraded":"2024-04-25T12:50:18.490836+0000","last_fullsized":"2024-04-25T12:50:18.490836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376123+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:18.376123+0000","last_peered":"2024-04-25T12:50:18.376123+0000","last_clean":"2024-04-25T12:50:18.376123+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:18.376123+0000","last_undegraded":"2024-04-25T12:50:18.376123+0000","last_fullsized":"2024-04-25T12:50:18.376123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375559+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:18.375559+0000","last_peered":"2024-04-25T12:50:18.375559+0000","last_clean":"2024-04-25T12:50:18.375559+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:18.375559+0000","last_undegraded":"2024-04-25T12:50:18.375559+0000","last_fullsized":"2024-04-25T12:50:18.375559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376235+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:18.376235+0000","last_peered":"2024-04-25T12:50:18.376235+0000","last_clean":"2024-04-25T12:50:18.376235+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:18.376235+0000","last_undegraded":"2024-04-25T12:50:18.376235+0000","last_fullsized":"2024-04-25T12:50:18.376235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490678+0000","last_change":"2024-04-25T12:50:13.364716+0000","last_active":"2024-04-25T12:50:18.490678+0000","last_peered":"2024-04-25T12:50:18.490678+0000","last_clean":"2024-04-25T12:50:18.490678+0000","last_became_active":"2024-04-25T12:50:13.364220+0000","last_became_peered":"2024-04-25T12:50:13.364220+0000","last_unstale":"2024-04-25T12:50:18.490678+0000","last_undegraded":"2024-04-25T12:50:18.490678+0000","last_fullsized":"2024-04-25T12:50:18.490678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:04.451868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373674+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:18.373674+0000","last_peered":"2024-04-25T12:50:18.373674+0000","last_clean":"2024-04-25T12:50:18.373674+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:18.373674+0000","last_undegraded":"2024-04-25T12:50:18.373674+0000","last_fullsized":"2024-04-25T12:50:18.373674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194164+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:19.194164+0000","last_peered":"2024-04-25T12:50:19.194164+0000","last_clean":"2024-04-25T12:50:19.194164+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:19.194164+0000","last_undegraded":"2024-04-25T12:50:19.194164+0000","last_fullsized":"2024-04-25T12:50:19.194164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194639+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:19.194639+0000","last_peered":"2024-04-25T12:50:19.194639+0000","last_clean":"2024-04-25T12:50:19.194639+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:19.194639+0000","last_undegraded":"2024-04-25T12:50:19.194639+0000","last_fullsized":"2024-04-25T12:50:19.194639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373856+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:18.373856+0000","last_peered":"2024-04-25T12:50:18.373856+0000","last_clean":"2024-04-25T12:50:18.373856+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:18.373856+0000","last_undegraded":"2024-04-25T12:50:18.373856+0000","last_fullsized":"2024-04-25T12:50:18.373856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193649+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:19.193649+0000","last_peered":"2024-04-25T12:50:19.193649+0000","last_clean":"2024-04-25T12:50:19.193649+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:19.193649+0000","last_undegraded":"2024-04-25T12:50:19.193649+0000","last_fullsized":"2024-04-25T12:50:19.193649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194115+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:19.194115+0000","last_peered":"2024-04-25T12:50:19.194115+0000","last_clean":"2024-04-25T12:50:19.194115+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:19.194115+0000","last_undegraded":"2024-04-25T12:50:19.194115+0000","last_fullsized":"2024-04-25T12:50:19.194115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373780+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:18.373780+0000","last_peered":"2024-04-25T12:50:18.373780+0000","last_clean":"2024-04-25T12:50:18.373780+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:18.373780+0000","last_undegraded":"2024-04-25T12:50:18.373780+0000","last_fullsized":"2024-04-25T12:50:18.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707963+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:18.707963+0000","last_peered":"2024-04-25T12:50:18.707963+0000","last_clean":"2024-04-25T12:50:18.707963+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:18.707963+0000","last_undegraded":"2024-04-25T12:50:18.707963+0000","last_fullsized":"2024-04-25T12:50:18.707963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194274+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:19.194274+0000","last_peered":"2024-04-25T12:50:19.194274+0000","last_clean":"2024-04-25T12:50:19.194274+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:19.194274+0000","last_undegraded":"2024-04-25T12:50:19.194274+0000","last_fullsized":"2024-04-25T12:50:19.194274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374554+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:18.374554+0000","last_peered":"2024-04-25T12:50:18.374554+0000","last_clean":"2024-04-25T12:50:18.374554+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:18.374554+0000","last_undegraded":"2024-04-25T12:50:18.374554+0000","last_fullsized":"2024-04-25T12:50:18.374554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375774+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:18.375774+0000","last_peered":"2024-04-25T12:50:18.375774+0000","last_clean":"2024-04-25T12:50:18.375774+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:18.375774+0000","last_undegraded":"2024-04-25T12:50:18.375774+0000","last_fullsized":"2024-04-25T12:50:18.375774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443390+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:18.443390+0000","last_peered":"2024-04-25T12:50:18.443390+0000","last_clean":"2024-04-25T12:50:18.443390+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:18.443390+0000","last_undegraded":"2024-04-25T12:50:18.443390+0000","last_fullsized":"2024-04-25T12:50:18.443390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374576+0000","last_change":"2024-04-25T12:50:17.391816+0000","last_active":"2024-04-25T12:50:18.374576+0000","last_peered":"2024-04-25T12:50:18.374576+0000","last_clean":"2024-04-25T12:50:18.374576+0000","last_became_active":"2024-04-25T12:50:17.390690+0000","last_became_peered":"2024-04-25T12:50:17.390690+0000","last_unstale":"2024-04-25T12:50:18.374576+0000","last_undegraded":"2024-04-25T12:50:18.374576+0000","last_fullsized":"2024-04-25T12:50:18.374576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:25.879819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375734+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:18.375734+0000","last_peered":"2024-04-25T12:50:18.375734+0000","last_clean":"2024-04-25T12:50:18.375734+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:18.375734+0000","last_undegraded":"2024-04-25T12:50:18.375734+0000","last_fullsized":"2024-04-25T12:50:18.375734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443166+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:18.443166+0000","last_peered":"2024-04-25T12:50:18.443166+0000","last_clean":"2024-04-25T12:50:18.443166+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:18.443166+0000","last_undegraded":"2024-04-25T12:50:18.443166+0000","last_fullsized":"2024-04-25T12:50:18.443166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443959+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:18.443959+0000","last_peered":"2024-04-25T12:50:18.443959+0000","last_clean":"2024-04-25T12:50:18.443959+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:18.443959+0000","last_undegraded":"2024-04-25T12:50:18.443959+0000","last_fullsized":"2024-04-25T12:50:18.443959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373924+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:18.373924+0000","last_peered":"2024-04-25T12:50:18.373924+0000","last_clean":"2024-04-25T12:50:18.373924+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:18.373924+0000","last_undegraded":"2024-04-25T12:50:18.373924+0000","last_fullsized":"2024-04-25T12:50:18.373924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193144+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:19.193144+0000","last_peered":"2024-04-25T12:50:19.193144+0000","last_clean":"2024-04-25T12:50:19.193144+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:19.193144+0000","last_undegraded":"2024-04-25T12:50:19.193144+0000","last_fullsized":"2024-04-25T12:50:19.193144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374315+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:18.374315+0000","last_peered":"2024-04-25T12:50:18.374315+0000","last_clean":"2024-04-25T12:50:18.374315+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:18.374315+0000","last_undegraded":"2024-04-25T12:50:18.374315+0000","last_fullsized":"2024-04-25T12:50:18.374315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491033+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:18.491033+0000","last_peered":"2024-04-25T12:50:18.491033+0000","last_clean":"2024-04-25T12:50:18.491033+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:18.491033+0000","last_undegraded":"2024-04-25T12:50:18.491033+0000","last_fullsized":"2024-04-25T12:50:18.491033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708733+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:18.708733+0000","last_peered":"2024-04-25T12:50:18.708733+0000","last_clean":"2024-04-25T12:50:18.708733+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:18.708733+0000","last_undegraded":"2024-04-25T12:50:18.708733+0000","last_fullsized":"2024-04-25T12:50:18.708733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373854+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:18.373854+0000","last_peered":"2024-04-25T12:50:18.373854+0000","last_clean":"2024-04-25T12:50:18.373854+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:18.373854+0000","last_undegraded":"2024-04-25T12:50:18.373854+0000","last_fullsized":"2024-04-25T12:50:18.373854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376351+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:18.376351+0000","last_peered":"2024-04-25T12:50:18.376351+0000","last_clean":"2024-04-25T12:50:18.376351+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:18.376351+0000","last_undegraded":"2024-04-25T12:50:18.376351+0000","last_fullsized":"2024-04-25T12:50:18.376351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443909+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:18.443909+0000","last_peered":"2024-04-25T12:50:18.443909+0000","last_clean":"2024-04-25T12:50:18.443909+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:18.443909+0000","last_undegraded":"2024-04-25T12:50:18.443909+0000","last_fullsized":"2024-04-25T12:50:18.443909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375492+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:18.375492+0000","last_peered":"2024-04-25T12:50:18.375492+0000","last_clean":"2024-04-25T12:50:18.375492+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:18.375492+0000","last_undegraded":"2024-04-25T12:50:18.375492+0000","last_fullsized":"2024-04-25T12:50:18.375492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443634+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:18.443634+0000","last_peered":"2024-04-25T12:50:18.443634+0000","last_clean":"2024-04-25T12:50:18.443634+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:18.443634+0000","last_undegraded":"2024-04-25T12:50:18.443634+0000","last_fullsized":"2024-04-25T12:50:18.443634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194390+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:19.194390+0000","last_peered":"2024-04-25T12:50:19.194390+0000","last_clean":"2024-04-25T12:50:19.194390+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:19.194390+0000","last_undegraded":"2024-04-25T12:50:19.194390+0000","last_fullsized":"2024-04-25T12:50:19.194390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490617+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:18.490617+0000","last_peered":"2024-04-25T12:50:18.490617+0000","last_clean":"2024-04-25T12:50:18.490617+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:18.490617+0000","last_undegraded":"2024-04-25T12:50:18.490617+0000","last_fullsized":"2024-04-25T12:50:18.490617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194216+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:19.194216+0000","last_peered":"2024-04-25T12:50:19.194216+0000","last_clean":"2024-04-25T12:50:19.194216+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:19.194216+0000","last_undegraded":"2024-04-25T12:50:19.194216+0000","last_fullsized":"2024-04-25T12:50:19.194216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443733+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:18.443733+0000","last_peered":"2024-04-25T12:50:18.443733+0000","last_clean":"2024-04-25T12:50:18.443733+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:18.443733+0000","last_undegraded":"2024-04-25T12:50:18.443733+0000","last_fullsized":"2024-04-25T12:50:18.443733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443260+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:18.443260+0000","last_peered":"2024-04-25T12:50:18.443260+0000","last_clean":"2024-04-25T12:50:18.443260+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:18.443260+0000","last_undegraded":"2024-04-25T12:50:18.443260+0000","last_fullsized":"2024-04-25T12:50:18.443260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374282+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:18.374282+0000","last_peered":"2024-04-25T12:50:18.374282+0000","last_clean":"2024-04-25T12:50:18.374282+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:18.374282+0000","last_undegraded":"2024-04-25T12:50:18.374282+0000","last_fullsized":"2024-04-25T12:50:18.374282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193689+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:19.193689+0000","last_peered":"2024-04-25T12:50:19.193689+0000","last_clean":"2024-04-25T12:50:19.193689+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:19.193689+0000","last_undegraded":"2024-04-25T12:50:19.193689+0000","last_fullsized":"2024-04-25T12:50:19.193689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443658+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:18.443658+0000","last_peered":"2024-04-25T12:50:18.443658+0000","last_clean":"2024-04-25T12:50:18.443658+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:18.443658+0000","last_undegraded":"2024-04-25T12:50:18.443658+0000","last_fullsized":"2024-04-25T12:50:18.443658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443155+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:18.443155+0000","last_peered":"2024-04-25T12:50:18.443155+0000","last_clean":"2024-04-25T12:50:18.443155+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:18.443155+0000","last_undegraded":"2024-04-25T12:50:18.443155+0000","last_fullsized":"2024-04-25T12:50:18.443155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193161+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:19.193161+0000","last_peered":"2024-04-25T12:50:19.193161+0000","last_clean":"2024-04-25T12:50:19.193161+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:19.193161+0000","last_undegraded":"2024-04-25T12:50:19.193161+0000","last_fullsized":"2024-04-25T12:50:19.193161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443997+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:18.443997+0000","last_peered":"2024-04-25T12:50:18.443997+0000","last_clean":"2024-04-25T12:50:18.443997+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:18.443997+0000","last_undegraded":"2024-04-25T12:50:18.443997+0000","last_fullsized":"2024-04-25T12:50:18.443997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490428+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:18.490428+0000","last_peered":"2024-04-25T12:50:18.490428+0000","last_clean":"2024-04-25T12:50:18.490428+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:18.490428+0000","last_undegraded":"2024-04-25T12:50:18.490428+0000","last_fullsized":"2024-04-25T12:50:18.490428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193145+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:19.193145+0000","last_peered":"2024-04-25T12:50:19.193145+0000","last_clean":"2024-04-25T12:50:19.193145+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:19.193145+0000","last_undegraded":"2024-04-25T12:50:19.193145+0000","last_fullsized":"2024-04-25T12:50:19.193145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491068+0000","last_change":"2024-04-25T12:50:17.401693+0000","last_active":"2024-04-25T12:50:18.491068+0000","last_peered":"2024-04-25T12:50:18.491068+0000","last_clean":"2024-04-25T12:50:18.491068+0000","last_became_active":"2024-04-25T12:50:17.401301+0000","last_became_peered":"2024-04-25T12:50:17.401301+0000","last_unstale":"2024-04-25T12:50:18.491068+0000","last_undegraded":"2024-04-25T12:50:18.491068+0000","last_fullsized":"2024-04-25T12:50:18.491068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:18.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375470+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:18.375470+0000","last_peered":"2024-04-25T12:50:18.375470+0000","last_clean":"2024-04-25T12:50:18.375470+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:18.375470+0000","last_undegraded":"2024-04-25T12:50:18.375470+0000","last_fullsized":"2024-04-25T12:50:18.375470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193598+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:19.193598+0000","last_peered":"2024-04-25T12:50:19.193598+0000","last_clean":"2024-04-25T12:50:19.193598+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:19.193598+0000","last_undegraded":"2024-04-25T12:50:19.193598+0000","last_fullsized":"2024-04-25T12:50:19.193598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193275+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:19.193275+0000","last_peered":"2024-04-25T12:50:19.193275+0000","last_clean":"2024-04-25T12:50:19.193275+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:19.193275+0000","last_undegraded":"2024-04-25T12:50:19.193275+0000","last_fullsized":"2024-04-25T12:50:19.193275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708408+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:18.708408+0000","last_peered":"2024-04-25T12:50:18.708408+0000","last_clean":"2024-04-25T12:50:18.708408+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:18.708408+0000","last_undegraded":"2024-04-25T12:50:18.708408+0000","last_fullsized":"2024-04-25T12:50:18.708408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193953+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:19.193953+0000","last_peered":"2024-04-25T12:50:19.193953+0000","last_clean":"2024-04-25T12:50:19.193953+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:19.193953+0000","last_undegraded":"2024-04-25T12:50:19.193953+0000","last_fullsized":"2024-04-25T12:50:19.193953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193281+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:19.193281+0000","last_peered":"2024-04-25T12:50:19.193281+0000","last_clean":"2024-04-25T12:50:19.193281+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:19.193281+0000","last_undegraded":"2024-04-25T12:50:19.193281+0000","last_fullsized":"2024-04-25T12:50:19.193281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708109+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:18.708109+0000","last_peered":"2024-04-25T12:50:18.708109+0000","last_clean":"2024-04-25T12:50:18.708109+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:18.708109+0000","last_undegraded":"2024-04-25T12:50:18.708109+0000","last_fullsized":"2024-04-25T12:50:18.708109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194752+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:19.194752+0000","last_peered":"2024-04-25T12:50:19.194752+0000","last_clean":"2024-04-25T12:50:19.194752+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:19.194752+0000","last_undegraded":"2024-04-25T12:50:19.194752+0000","last_fullsized":"2024-04-25T12:50:19.194752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443731+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:18.443731+0000","last_peered":"2024-04-25T12:50:18.443731+0000","last_clean":"2024-04-25T12:50:18.443731+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:18.443731+0000","last_undegraded":"2024-04-25T12:50:18.443731+0000","last_fullsized":"2024-04-25T12:50:18.443731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490742+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:18.490742+0000","last_peered":"2024-04-25T12:50:18.490742+0000","last_clean":"2024-04-25T12:50:18.490742+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:18.490742+0000","last_undegraded":"2024-04-25T12:50:18.490742+0000","last_fullsized":"2024-04-25T12:50:18.490742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194447+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:19.194447+0000","last_peered":"2024-04-25T12:50:19.194447+0000","last_clean":"2024-04-25T12:50:19.194447+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:19.194447+0000","last_undegraded":"2024-04-25T12:50:19.194447+0000","last_fullsized":"2024-04-25T12:50:19.194447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193280+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:19.193280+0000","last_peered":"2024-04-25T12:50:19.193280+0000","last_clean":"2024-04-25T12:50:19.193280+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:19.193280+0000","last_undegraded":"2024-04-25T12:50:19.193280+0000","last_fullsized":"2024-04-25T12:50:19.193280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193177+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:19.193177+0000","last_peered":"2024-04-25T12:50:19.193177+0000","last_clean":"2024-04-25T12:50:19.193177+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:19.193177+0000","last_undegraded":"2024-04-25T12:50:19.193177+0000","last_fullsized":"2024-04-25T12:50:19.193177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194335+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:19.194335+0000","last_peered":"2024-04-25T12:50:19.194335+0000","last_clean":"2024-04-25T12:50:19.194335+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:19.194335+0000","last_undegraded":"2024-04-25T12:50:19.194335+0000","last_fullsized":"2024-04-25T12:50:19.194335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374456+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:18.374456+0000","last_peered":"2024-04-25T12:50:18.374456+0000","last_clean":"2024-04-25T12:50:18.374456+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:18.374456+0000","last_undegraded":"2024-04-25T12:50:18.374456+0000","last_fullsized":"2024-04-25T12:50:18.374456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373647+0000","last_change":"2024-04-25T12:50:17.392618+0000","last_active":"2024-04-25T12:50:18.373647+0000","last_peered":"2024-04-25T12:50:18.373647+0000","last_clean":"2024-04-25T12:50:18.373647+0000","last_became_active":"2024-04-25T12:50:17.392252+0000","last_became_peered":"2024-04-25T12:50:17.392252+0000","last_unstale":"2024-04-25T12:50:18.373647+0000","last_undegraded":"2024-04-25T12:50:18.373647+0000","last_fullsized":"2024-04-25T12:50:18.373647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:21.181630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193639+0000","last_change":"2024-04-25T12:50:13.367452+0000","last_active":"2024-04-25T12:50:19.193639+0000","last_peered":"2024-04-25T12:50:19.193639+0000","last_clean":"2024-04-25T12:50:19.193639+0000","last_became_active":"2024-04-25T12:50:13.367191+0000","last_became_peered":"2024-04-25T12:50:13.367191+0000","last_unstale":"2024-04-25T12:50:19.193639+0000","last_undegraded":"2024-04-25T12:50:19.193639+0000","last_fullsized":"2024-04-25T12:50:19.193639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:22.674147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192881+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:19.192881+0000","last_peered":"2024-04-25T12:50:19.192881+0000","last_clean":"2024-04-25T12:50:19.192881+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:19.192881+0000","last_undegraded":"2024-04-25T12:50:19.192881+0000","last_fullsized":"2024-04-25T12:50:19.192881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490922+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:18.490922+0000","last_peered":"2024-04-25T12:50:18.490922+0000","last_clean":"2024-04-25T12:50:18.490922+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:18.490922+0000","last_undegraded":"2024-04-25T12:50:18.490922+0000","last_fullsized":"2024-04-25T12:50:18.490922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708208+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:18.708208+0000","last_peered":"2024-04-25T12:50:18.708208+0000","last_clean":"2024-04-25T12:50:18.708208+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:18.708208+0000","last_undegraded":"2024-04-25T12:50:18.708208+0000","last_fullsized":"2024-04-25T12:50:18.708208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708149+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:18.708149+0000","last_peered":"2024-04-25T12:50:18.708149+0000","last_clean":"2024-04-25T12:50:18.708149+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:18.708149+0000","last_undegraded":"2024-04-25T12:50:18.708149+0000","last_fullsized":"2024-04-25T12:50:18.708149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376312+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:18.376312+0000","last_peered":"2024-04-25T12:50:18.376312+0000","last_clean":"2024-04-25T12:50:18.376312+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:18.376312+0000","last_undegraded":"2024-04-25T12:50:18.376312+0000","last_fullsized":"2024-04-25T12:50:18.376312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194172+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:19.194172+0000","last_peered":"2024-04-25T12:50:19.194172+0000","last_clean":"2024-04-25T12:50:19.194172+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:19.194172+0000","last_undegraded":"2024-04-25T12:50:19.194172+0000","last_fullsized":"2024-04-25T12:50:19.194172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193812+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:19.193812+0000","last_peered":"2024-04-25T12:50:19.193812+0000","last_clean":"2024-04-25T12:50:19.193812+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:19.193812+0000","last_undegraded":"2024-04-25T12:50:19.193812+0000","last_fullsized":"2024-04-25T12:50:19.193812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376048+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:18.376048+0000","last_peered":"2024-04-25T12:50:18.376048+0000","last_clean":"2024-04-25T12:50:18.376048+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:18.376048+0000","last_undegraded":"2024-04-25T12:50:18.376048+0000","last_fullsized":"2024-04-25T12:50:18.376048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490628+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:18.490628+0000","last_peered":"2024-04-25T12:50:18.490628+0000","last_clean":"2024-04-25T12:50:18.490628+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:18.490628+0000","last_undegraded":"2024-04-25T12:50:18.490628+0000","last_fullsized":"2024-04-25T12:50:18.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490899+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:18.490899+0000","last_peered":"2024-04-25T12:50:18.490899+0000","last_clean":"2024-04-25T12:50:18.490899+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:18.490899+0000","last_undegraded":"2024-04-25T12:50:18.490899+0000","last_fullsized":"2024-04-25T12:50:18.490899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194059+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:19.194059+0000","last_peered":"2024-04-25T12:50:19.194059+0000","last_clean":"2024-04-25T12:50:19.194059+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:19.194059+0000","last_undegraded":"2024-04-25T12:50:19.194059+0000","last_fullsized":"2024-04-25T12:50:19.194059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193830+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:19.193830+0000","last_peered":"2024-04-25T12:50:19.193830+0000","last_clean":"2024-04-25T12:50:19.193830+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:19.193830+0000","last_undegraded":"2024-04-25T12:50:19.193830+0000","last_fullsized":"2024-04-25T12:50:19.193830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:27.695335+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:27.695335+0000","last_peered":"2024-04-25T12:50:27.695335+0000","last_clean":"2024-04-25T12:50:27.695335+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:27.695335+0000","last_undegraded":"2024-04-25T12:50:27.695335+0000","last_fullsized":"2024-04-25T12:50:27.695335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443311+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:18.443311+0000","last_peered":"2024-04-25T12:50:18.443311+0000","last_clean":"2024-04-25T12:50:18.443311+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:18.443311+0000","last_undegraded":"2024-04-25T12:50:18.443311+0000","last_fullsized":"2024-04-25T12:50:18.443311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374509+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:18.374509+0000","last_peered":"2024-04-25T12:50:18.374509+0000","last_clean":"2024-04-25T12:50:18.374509+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:18.374509+0000","last_undegraded":"2024-04-25T12:50:18.374509+0000","last_fullsized":"2024-04-25T12:50:18.374509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443678+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:18.443678+0000","last_peered":"2024-04-25T12:50:18.443678+0000","last_clean":"2024-04-25T12:50:18.443678+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:18.443678+0000","last_undegraded":"2024-04-25T12:50:18.443678+0000","last_fullsized":"2024-04-25T12:50:18.443678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374070+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:18.374070+0000","last_peered":"2024-04-25T12:50:18.374070+0000","last_clean":"2024-04-25T12:50:18.374070+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:18.374070+0000","last_undegraded":"2024-04-25T12:50:18.374070+0000","last_fullsized":"2024-04-25T12:50:18.374070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490802+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:18.490802+0000","last_peered":"2024-04-25T12:50:18.490802+0000","last_clean":"2024-04-25T12:50:18.490802+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:18.490802+0000","last_undegraded":"2024-04-25T12:50:18.490802+0000","last_fullsized":"2024-04-25T12:50:18.490802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194108+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:19.194108+0000","last_peered":"2024-04-25T12:50:19.194108+0000","last_clean":"2024-04-25T12:50:19.194108+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:19.194108+0000","last_undegraded":"2024-04-25T12:50:19.194108+0000","last_fullsized":"2024-04-25T12:50:19.194108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375750+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:18.375750+0000","last_peered":"2024-04-25T12:50:18.375750+0000","last_clean":"2024-04-25T12:50:18.375750+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:18.375750+0000","last_undegraded":"2024-04-25T12:50:18.375750+0000","last_fullsized":"2024-04-25T12:50:18.375750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194015+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:19.194015+0000","last_peered":"2024-04-25T12:50:19.194015+0000","last_clean":"2024-04-25T12:50:19.194015+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:19.194015+0000","last_undegraded":"2024-04-25T12:50:19.194015+0000","last_fullsized":"2024-04-25T12:50:19.194015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708598+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:18.708598+0000","last_peered":"2024-04-25T12:50:18.708598+0000","last_clean":"2024-04-25T12:50:18.708598+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:18.708598+0000","last_undegraded":"2024-04-25T12:50:18.708598+0000","last_fullsized":"2024-04-25T12:50:18.708598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375629+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:18.375629+0000","last_peered":"2024-04-25T12:50:18.375629+0000","last_clean":"2024-04-25T12:50:18.375629+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:18.375629+0000","last_undegraded":"2024-04-25T12:50:18.375629+0000","last_fullsized":"2024-04-25T12:50:18.375629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490933+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:18.490933+0000","last_peered":"2024-04-25T12:50:18.490933+0000","last_clean":"2024-04-25T12:50:18.490933+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:18.490933+0000","last_undegraded":"2024-04-25T12:50:18.490933+0000","last_fullsized":"2024-04-25T12:50:18.490933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443059+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:18.443059+0000","last_peered":"2024-04-25T12:50:18.443059+0000","last_clean":"2024-04-25T12:50:18.443059+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:18.443059+0000","last_undegraded":"2024-04-25T12:50:18.443059+0000","last_fullsized":"2024-04-25T12:50:18.443059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193400+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:19.193400+0000","last_peered":"2024-04-25T12:50:19.193400+0000","last_clean":"2024-04-25T12:50:19.193400+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:19.193400+0000","last_undegraded":"2024-04-25T12:50:19.193400+0000","last_fullsized":"2024-04-25T12:50:19.193400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708614+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:18.708614+0000","last_peered":"2024-04-25T12:50:18.708614+0000","last_clean":"2024-04-25T12:50:18.708614+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:18.708614+0000","last_undegraded":"2024-04-25T12:50:18.708614+0000","last_fullsized":"2024-04-25T12:50:18.708614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375619+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:18.375619+0000","last_peered":"2024-04-25T12:50:18.375619+0000","last_clean":"2024-04-25T12:50:18.375619+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:18.375619+0000","last_undegraded":"2024-04-25T12:50:18.375619+0000","last_fullsized":"2024-04-25T12:50:18.375619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375790+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:18.375790+0000","last_peered":"2024-04-25T12:50:18.375790+0000","last_clean":"2024-04-25T12:50:18.375790+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:18.375790+0000","last_undegraded":"2024-04-25T12:50:18.375790+0000","last_fullsized":"2024-04-25T12:50:18.375790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708432+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:18.708432+0000","last_peered":"2024-04-25T12:50:18.708432+0000","last_clean":"2024-04-25T12:50:18.708432+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:18.708432+0000","last_undegraded":"2024-04-25T12:50:18.708432+0000","last_fullsized":"2024-04-25T12:50:18.708432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490790+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:18.490790+0000","last_peered":"2024-04-25T12:50:18.490790+0000","last_clean":"2024-04-25T12:50:18.490790+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:18.490790+0000","last_undegraded":"2024-04-25T12:50:18.490790+0000","last_fullsized":"2024-04-25T12:50:18.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193090+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:19.193090+0000","last_peered":"2024-04-25T12:50:19.193090+0000","last_clean":"2024-04-25T12:50:19.193090+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:19.193090+0000","last_undegraded":"2024-04-25T12:50:19.193090+0000","last_fullsized":"2024-04-25T12:50:19.193090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375880+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:18.375880+0000","last_peered":"2024-04-25T12:50:18.375880+0000","last_clean":"2024-04-25T12:50:18.375880+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:18.375880+0000","last_undegraded":"2024-04-25T12:50:18.375880+0000","last_fullsized":"2024-04-25T12:50:18.375880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374019+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:18.374019+0000","last_peered":"2024-04-25T12:50:18.374019+0000","last_clean":"2024-04-25T12:50:18.374019+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:18.374019+0000","last_undegraded":"2024-04-25T12:50:18.374019+0000","last_fullsized":"2024-04-25T12:50:18.374019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375974+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:18.375974+0000","last_peered":"2024-04-25T12:50:18.375974+0000","last_clean":"2024-04-25T12:50:18.375974+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:18.375974+0000","last_undegraded":"2024-04-25T12:50:18.375974+0000","last_fullsized":"2024-04-25T12:50:18.375974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707993+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:18.707993+0000","last_peered":"2024-04-25T12:50:18.707993+0000","last_clean":"2024-04-25T12:50:18.707993+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:18.707993+0000","last_undegraded":"2024-04-25T12:50:18.707993+0000","last_fullsized":"2024-04-25T12:50:18.707993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192896+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:19.192896+0000","last_peered":"2024-04-25T12:50:19.192896+0000","last_clean":"2024-04-25T12:50:19.192896+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:19.192896+0000","last_undegraded":"2024-04-25T12:50:19.192896+0000","last_fullsized":"2024-04-25T12:50:19.192896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193566+0000","last_change":"2024-04-25T12:50:13.358445+0000","last_active":"2024-04-25T12:50:19.193566+0000","last_peered":"2024-04-25T12:50:19.193566+0000","last_clean":"2024-04-25T12:50:19.193566+0000","last_became_active":"2024-04-25T12:50:13.358182+0000","last_became_peered":"2024-04-25T12:50:13.358182+0000","last_unstale":"2024-04-25T12:50:19.193566+0000","last_undegraded":"2024-04-25T12:50:19.193566+0000","last_fullsized":"2024-04-25T12:50:19.193566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:46.419647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490749+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:18.490749+0000","last_peered":"2024-04-25T12:50:18.490749+0000","last_clean":"2024-04-25T12:50:18.490749+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:18.490749+0000","last_undegraded":"2024-04-25T12:50:18.490749+0000","last_fullsized":"2024-04-25T12:50:18.490749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376132+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:18.376132+0000","last_peered":"2024-04-25T12:50:18.376132+0000","last_clean":"2024-04-25T12:50:18.376132+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:18.376132+0000","last_undegraded":"2024-04-25T12:50:18.376132+0000","last_fullsized":"2024-04-25T12:50:18.376132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443568+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:18.443568+0000","last_peered":"2024-04-25T12:50:18.443568+0000","last_clean":"2024-04-25T12:50:18.443568+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:18.443568+0000","last_undegraded":"2024-04-25T12:50:18.443568+0000","last_fullsized":"2024-04-25T12:50:18.443568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708601+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:18.708601+0000","last_peered":"2024-04-25T12:50:18.708601+0000","last_clean":"2024-04-25T12:50:18.708601+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:18.708601+0000","last_undegraded":"2024-04-25T12:50:18.708601+0000","last_fullsized":"2024-04-25T12:50:18.708601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376259+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:18.376259+0000","last_peered":"2024-04-25T12:50:18.376259+0000","last_clean":"2024-04-25T12:50:18.376259+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:18.376259+0000","last_undegraded":"2024-04-25T12:50:18.376259+0000","last_fullsized":"2024-04-25T12:50:18.376259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193289+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:19.193289+0000","last_peered":"2024-04-25T12:50:19.193289+0000","last_clean":"2024-04-25T12:50:19.193289+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:19.193289+0000","last_undegraded":"2024-04-25T12:50:19.193289+0000","last_fullsized":"2024-04-25T12:50:19.193289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375698+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:18.375698+0000","last_peered":"2024-04-25T12:50:18.375698+0000","last_clean":"2024-04-25T12:50:18.375698+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:18.375698+0000","last_undegraded":"2024-04-25T12:50:18.375698+0000","last_fullsized":"2024-04-25T12:50:18.375698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193540+0000","last_change":"2024-04-25T12:50:13.369544+0000","last_active":"2024-04-25T12:50:19.193540+0000","last_peered":"2024-04-25T12:50:19.193540+0000","last_clean":"2024-04-25T12:50:19.193540+0000","last_became_active":"2024-04-25T12:50:13.369254+0000","last_became_peered":"2024-04-25T12:50:13.369254+0000","last_unstale":"2024-04-25T12:50:19.193540+0000","last_undegraded":"2024-04-25T12:50:19.193540+0000","last_fullsized":"2024-04-25T12:50:19.193540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:07.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490531+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:18.490531+0000","last_peered":"2024-04-25T12:50:18.490531+0000","last_clean":"2024-04-25T12:50:18.490531+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:18.490531+0000","last_undegraded":"2024-04-25T12:50:18.490531+0000","last_fullsized":"2024-04-25T12:50:18.490531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708357+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:18.708357+0000","last_peered":"2024-04-25T12:50:18.708357+0000","last_clean":"2024-04-25T12:50:18.708357+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:18.708357+0000","last_undegraded":"2024-04-25T12:50:18.708357+0000","last_fullsized":"2024-04-25T12:50:18.708357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194284+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:19.194284+0000","last_peered":"2024-04-25T12:50:19.194284+0000","last_clean":"2024-04-25T12:50:19.194284+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:19.194284+0000","last_undegraded":"2024-04-25T12:50:19.194284+0000","last_fullsized":"2024-04-25T12:50:19.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193222+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:19.193222+0000","last_peered":"2024-04-25T12:50:19.193222+0000","last_clean":"2024-04-25T12:50:19.193222+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:19.193222+0000","last_undegraded":"2024-04-25T12:50:19.193222+0000","last_fullsized":"2024-04-25T12:50:19.193222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194416+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:19.194416+0000","last_peered":"2024-04-25T12:50:19.194416+0000","last_clean":"2024-04-25T12:50:19.194416+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:19.194416+0000","last_undegraded":"2024-04-25T12:50:19.194416+0000","last_fullsized":"2024-04-25T12:50:19.194416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193130+0000","last_change":"2024-04-25T12:50:13.361730+0000","last_active":"2024-04-25T12:50:19.193130+0000","last_peered":"2024-04-25T12:50:19.193130+0000","last_clean":"2024-04-25T12:50:19.193130+0000","last_became_active":"2024-04-25T12:50:13.361305+0000","last_became_peered":"2024-04-25T12:50:13.361305+0000","last_unstale":"2024-04-25T12:50:19.193130+0000","last_undegraded":"2024-04-25T12:50:19.193130+0000","last_fullsized":"2024-04-25T12:50:19.193130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.112968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443125+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:18.443125+0000","last_peered":"2024-04-25T12:50:18.443125+0000","last_clean":"2024-04-25T12:50:18.443125+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:18.443125+0000","last_undegraded":"2024-04-25T12:50:18.443125+0000","last_fullsized":"2024-04-25T12:50:18.443125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490744+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:18.490744+0000","last_peered":"2024-04-25T12:50:18.490744+0000","last_clean":"2024-04-25T12:50:18.490744+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:18.490744+0000","last_undegraded":"2024-04-25T12:50:18.490744+0000","last_fullsized":"2024-04-25T12:50:18.490744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375678+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:18.375678+0000","last_peered":"2024-04-25T12:50:18.375678+0000","last_clean":"2024-04-25T12:50:18.375678+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:18.375678+0000","last_undegraded":"2024-04-25T12:50:18.375678+0000","last_fullsized":"2024-04-25T12:50:18.375678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374421+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:18.374421+0000","last_peered":"2024-04-25T12:50:18.374421+0000","last_clean":"2024-04-25T12:50:18.374421+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:18.374421+0000","last_undegraded":"2024-04-25T12:50:18.374421+0000","last_fullsized":"2024-04-25T12:50:18.374421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708474+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:18.708474+0000","last_peered":"2024-04-25T12:50:18.708474+0000","last_clean":"2024-04-25T12:50:18.708474+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:18.708474+0000","last_undegraded":"2024-04-25T12:50:18.708474+0000","last_fullsized":"2024-04-25T12:50:18.708474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708530+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:18.708530+0000","last_peered":"2024-04-25T12:50:18.708530+0000","last_clean":"2024-04-25T12:50:18.708530+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:18.708530+0000","last_undegraded":"2024-04-25T12:50:18.708530+0000","last_fullsized":"2024-04-25T12:50:18.708530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194342+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:19.194342+0000","last_peered":"2024-04-25T12:50:19.194342+0000","last_clean":"2024-04-25T12:50:19.194342+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:19.194342+0000","last_undegraded":"2024-04-25T12:50:19.194342+0000","last_fullsized":"2024-04-25T12:50:19.194342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375421+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:18.375421+0000","last_peered":"2024-04-25T12:50:18.375421+0000","last_clean":"2024-04-25T12:50:18.375421+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:18.375421+0000","last_undegraded":"2024-04-25T12:50:18.375421+0000","last_fullsized":"2024-04-25T12:50:18.375421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193509+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:19.193509+0000","last_peered":"2024-04-25T12:50:19.193509+0000","last_clean":"2024-04-25T12:50:19.193509+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:19.193509+0000","last_undegraded":"2024-04-25T12:50:19.193509+0000","last_fullsized":"2024-04-25T12:50:19.193509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193428+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:19.193428+0000","last_peered":"2024-04-25T12:50:19.193428+0000","last_clean":"2024-04-25T12:50:19.193428+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:19.193428+0000","last_undegraded":"2024-04-25T12:50:19.193428+0000","last_fullsized":"2024-04-25T12:50:19.193428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193961+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:19.193961+0000","last_peered":"2024-04-25T12:50:19.193961+0000","last_clean":"2024-04-25T12:50:19.193961+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:19.193961+0000","last_undegraded":"2024-04-25T12:50:19.193961+0000","last_fullsized":"2024-04-25T12:50:19.193961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194637+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:19.194637+0000","last_peered":"2024-04-25T12:50:19.194637+0000","last_clean":"2024-04-25T12:50:19.194637+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:19.194637+0000","last_undegraded":"2024-04-25T12:50:19.194637+0000","last_fullsized":"2024-04-25T12:50:19.194637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490720+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:18.490720+0000","last_peered":"2024-04-25T12:50:18.490720+0000","last_clean":"2024-04-25T12:50:18.490720+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:18.490720+0000","last_undegraded":"2024-04-25T12:50:18.490720+0000","last_fullsized":"2024-04-25T12:50:18.490720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443835+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:18.443835+0000","last_peered":"2024-04-25T12:50:18.443835+0000","last_clean":"2024-04-25T12:50:18.443835+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:18.443835+0000","last_undegraded":"2024-04-25T12:50:18.443835+0000","last_fullsized":"2024-04-25T12:50:18.443835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194154+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:19.194154+0000","last_peered":"2024-04-25T12:50:19.194154+0000","last_clean":"2024-04-25T12:50:19.194154+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:19.194154+0000","last_undegraded":"2024-04-25T12:50:19.194154+0000","last_fullsized":"2024-04-25T12:50:19.194154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":104457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":104493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":104367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:42.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:42.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.517+0000 7f1b59b08640 1 Processor -- start 2024-04-25T12:50:42.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.517+0000 7f1b59b08640 1 -- start start 2024-04-25T12:50:42.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b59b08640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1b5415bec0 0x7f1b540d0c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b59b08640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b540d1620 con 0x7f1b540d11d0 2024-04-25T12:50:42.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b59b08640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b5415e9d0 con 0x7f1b54155460 2024-04-25T12:50:42.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b59b08640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1b540d1890 con 0x7f1b5415bec0 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b53fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1b540d11d0 0x7f1b540b4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36848/0 (socket says 172.21.15.132:36848) 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b53fff640 1 -- 172.21.15.132:0/1642530211 learned_addr learned my addr 172.21.15.132:0/1642530211 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b52ffd640 1 --2- 172.21.15.132:0/1642530211 >> v2:172.21.15.157:3300/0 conn(0x7f1b5415bec0 0x7f1b540d0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b527fc640 1 -- 172.21.15.132:0/1642530211 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976088716 0 0) 0x7f1b540d1620 con 0x7f1b540d11d0 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b527fc640 1 -- 172.21.15.132:0/1642530211 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b3c003520 con 0x7f1b540d11d0 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.518+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1642530211 >> v1:172.21.15.157:6789/0 conn(0x7f1b54155460 legacy=0x7f1b540cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.519+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1642530211 >> v1:172.21.15.132:6789/0 conn(0x7f1b540d11d0 legacy=0x7f1b540b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.519+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1642530211 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b5415ecb0 con 0x7f1b5415bec0 2024-04-25T12:50:42.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.519+0000 7f1b52ffd640 1 --2- 172.21.15.132:0/1642530211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b540d0c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b540d1a10 tx=0x7f1b4802a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbc8dbb89083c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.519+0000 7f1b527fc640 1 -- 172.21.15.132:0/1642530211 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48037070 con 0x7f1b5415bec0 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.519+0000 7f1b527fc640 1 -- 172.21.15.132:0/1642530211 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b48032440 con 0x7f1b5415bec0 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.519+0000 7f1b527fc640 1 -- 172.21.15.132:0/1642530211 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480327f0 con 0x7f1b5415bec0 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 -- 172.21.15.132:0/1642530211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 msgr2=0x7f1b540d0c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1642530211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b540d0c90 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f1b540d1a10 tx=0x7f1b4802a210 comp rx=0 tx=0).stop 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 -- 172.21.15.132:0/1642530211 shutdown_connections 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1642530211 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b540d0c90 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 -- 172.21.15.132:0/1642530211 >> 172.21.15.132:0/1642530211 conn(0x7f1b54067810 msgr2=0x7f1b54067c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 -- 172.21.15.132:0/1642530211 shutdown_connections 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.520+0000 7f1b59b08640 1 -- 172.21.15.132:0/1642530211 wait complete. 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.521+0000 7f1b59b08640 1 Processor -- start 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.521+0000 7f1b59b08640 1 -- start start 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b59b08640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b540d11d0 0x7f1b5414c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b59b08640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 0x7f1b5415e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b59b08640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b541e6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b59b08640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5415f550 con 0x7f1b54155460 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b59b08640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1b5415f270 con 0x7f1b5415bec0 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b59b08640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1b54155840 con 0x7f1b540d11d0 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 0x7f1b5415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 0x7f1b5415e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51272/0 (socket says 172.21.15.132:51272) 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1689039418 learned_addr learned my addr 172.21.15.132:0/1689039418 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b53fff640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b541e6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b537fe640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b540d11d0 0x7f1b5414c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b540d11d0 msgr2=0x7f1b5414c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b540d11d0 0x7f1b5414c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 msgr2=0x7f1b541e6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b541e6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b52ffd640 1 -- 172.21.15.132:0/1689039418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b541f2180 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.522+0000 7f1b537fe640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b540d11d0 0x7f1b5414c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.523+0000 7f1b52ffd640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 0x7f1b5415e010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009880 tx=0x7f1b480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.523+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b48037050 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.523+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b48043070 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.523+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b541e4760 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.523+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b480327f0 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.523+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b541e4d20 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.524+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b54068c20 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.524+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b48032990 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.525+0000 7f1b3bfff640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1b4006c8f0 0x7f1b4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.525+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1b480aca50 con 0x7f1b54155460 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.525+0000 7f1b537fe640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1b4006c8f0 0x7f1b4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.525+0000 7f1b537fe640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1b4006c8f0 0x7f1b4006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001700 tx=0x7f1b44009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.529+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b480044a0 con 0x7f1b54155460 2024-04-25T12:50:42.698 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.700+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1b54069700 con 0x7f1b4006c8f0 2024-04-25T12:50:42.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.707+0000 7f1b3bfff640 1 -- 172.21.15.132:0/1689039418 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f1b44001340 con 0x7f1b4006c8f0 2024-04-25T12:50:42.709 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:42.711 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1b4006c8f0 msgr2=0x7f1b4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1b4006c8f0 0x7f1b4006edb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1b44001700 tx=0x7f1b44009040 comp rx=0 tx=0).stop 2024-04-25T12:50:42.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 msgr2=0x7f1b5415e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 0x7f1b5415e010 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009880 tx=0x7f1b480046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 shutdown_connections 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1b4006c8f0 0x7f1b4006edb0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1b5415bec0 0x7f1b541e6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1b54155460 0x7f1b5415e010 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 --2- 172.21.15.132:0/1689039418 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1b540d11d0 0x7f1b5414c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 >> 172.21.15.132:0/1689039418 conn(0x7f1b54067810 msgr2=0x7f1b540b5650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 shutdown_connections 2024-04-25T12:50:42.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.711+0000 7f1b59b08640 1 -- 172.21.15.132:0/1689039418 wait complete. 2024-04-25T12:50:42.722 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T12:50:41.133207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231920,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742800,"statfs":{"total":773094113280,"available":772856627200,"internally_reserved":0,"allocated":3350528,"data_stored":2024952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003126"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490836+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:18.490836+0000","last_peered":"2024-04-25T12:50:18.490836+0000","last_clean":"2024-04-25T12:50:18.490836+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:18.490836+0000","last_undegraded":"2024-04-25T12:50:18.490836+0000","last_fullsized":"2024-04-25T12:50:18.490836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376123+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:18.376123+0000","last_peered":"2024-04-25T12:50:18.376123+0000","last_clean":"2024-04-25T12:50:18.376123+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:18.376123+0000","last_undegraded":"2024-04-25T12:50:18.376123+0000","last_fullsized":"2024-04-25T12:50:18.376123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375559+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:18.375559+0000","last_peered":"2024-04-25T12:50:18.375559+0000","last_clean":"2024-04-25T12:50:18.375559+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:18.375559+0000","last_undegraded":"2024-04-25T12:50:18.375559+0000","last_fullsized":"2024-04-25T12:50:18.375559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376235+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:18.376235+0000","last_peered":"2024-04-25T12:50:18.376235+0000","last_clean":"2024-04-25T12:50:18.376235+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:18.376235+0000","last_undegraded":"2024-04-25T12:50:18.376235+0000","last_fullsized":"2024-04-25T12:50:18.376235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490678+0000","last_change":"2024-04-25T12:50:13.364716+0000","last_active":"2024-04-25T12:50:18.490678+0000","last_peered":"2024-04-25T12:50:18.490678+0000","last_clean":"2024-04-25T12:50:18.490678+0000","last_became_active":"2024-04-25T12:50:13.364220+0000","last_became_peered":"2024-04-25T12:50:13.364220+0000","last_unstale":"2024-04-25T12:50:18.490678+0000","last_undegraded":"2024-04-25T12:50:18.490678+0000","last_fullsized":"2024-04-25T12:50:18.490678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:04.451868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373674+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:18.373674+0000","last_peered":"2024-04-25T12:50:18.373674+0000","last_clean":"2024-04-25T12:50:18.373674+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:18.373674+0000","last_undegraded":"2024-04-25T12:50:18.373674+0000","last_fullsized":"2024-04-25T12:50:18.373674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194164+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:19.194164+0000","last_peered":"2024-04-25T12:50:19.194164+0000","last_clean":"2024-04-25T12:50:19.194164+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:19.194164+0000","last_undegraded":"2024-04-25T12:50:19.194164+0000","last_fullsized":"2024-04-25T12:50:19.194164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194639+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:19.194639+0000","last_peered":"2024-04-25T12:50:19.194639+0000","last_clean":"2024-04-25T12:50:19.194639+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:19.194639+0000","last_undegraded":"2024-04-25T12:50:19.194639+0000","last_fullsized":"2024-04-25T12:50:19.194639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373856+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:18.373856+0000","last_peered":"2024-04-25T12:50:18.373856+0000","last_clean":"2024-04-25T12:50:18.373856+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:18.373856+0000","last_undegraded":"2024-04-25T12:50:18.373856+0000","last_fullsized":"2024-04-25T12:50:18.373856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193649+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:19.193649+0000","last_peered":"2024-04-25T12:50:19.193649+0000","last_clean":"2024-04-25T12:50:19.193649+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:19.193649+0000","last_undegraded":"2024-04-25T12:50:19.193649+0000","last_fullsized":"2024-04-25T12:50:19.193649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194115+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:19.194115+0000","last_peered":"2024-04-25T12:50:19.194115+0000","last_clean":"2024-04-25T12:50:19.194115+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:19.194115+0000","last_undegraded":"2024-04-25T12:50:19.194115+0000","last_fullsized":"2024-04-25T12:50:19.194115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373780+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:18.373780+0000","last_peered":"2024-04-25T12:50:18.373780+0000","last_clean":"2024-04-25T12:50:18.373780+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:18.373780+0000","last_undegraded":"2024-04-25T12:50:18.373780+0000","last_fullsized":"2024-04-25T12:50:18.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707963+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:18.707963+0000","last_peered":"2024-04-25T12:50:18.707963+0000","last_clean":"2024-04-25T12:50:18.707963+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:18.707963+0000","last_undegraded":"2024-04-25T12:50:18.707963+0000","last_fullsized":"2024-04-25T12:50:18.707963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194274+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:19.194274+0000","last_peered":"2024-04-25T12:50:19.194274+0000","last_clean":"2024-04-25T12:50:19.194274+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:19.194274+0000","last_undegraded":"2024-04-25T12:50:19.194274+0000","last_fullsized":"2024-04-25T12:50:19.194274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374554+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:18.374554+0000","last_peered":"2024-04-25T12:50:18.374554+0000","last_clean":"2024-04-25T12:50:18.374554+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:18.374554+0000","last_undegraded":"2024-04-25T12:50:18.374554+0000","last_fullsized":"2024-04-25T12:50:18.374554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375774+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:18.375774+0000","last_peered":"2024-04-25T12:50:18.375774+0000","last_clean":"2024-04-25T12:50:18.375774+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:18.375774+0000","last_undegraded":"2024-04-25T12:50:18.375774+0000","last_fullsized":"2024-04-25T12:50:18.375774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443390+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:18.443390+0000","last_peered":"2024-04-25T12:50:18.443390+0000","last_clean":"2024-04-25T12:50:18.443390+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:18.443390+0000","last_undegraded":"2024-04-25T12:50:18.443390+0000","last_fullsized":"2024-04-25T12:50:18.443390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374576+0000","last_change":"2024-04-25T12:50:17.391816+0000","last_active":"2024-04-25T12:50:18.374576+0000","last_peered":"2024-04-25T12:50:18.374576+0000","last_clean":"2024-04-25T12:50:18.374576+0000","last_became_active":"2024-04-25T12:50:17.390690+0000","last_became_peered":"2024-04-25T12:50:17.390690+0000","last_unstale":"2024-04-25T12:50:18.374576+0000","last_undegraded":"2024-04-25T12:50:18.374576+0000","last_fullsized":"2024-04-25T12:50:18.374576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:25.879819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375734+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:18.375734+0000","last_peered":"2024-04-25T12:50:18.375734+0000","last_clean":"2024-04-25T12:50:18.375734+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:18.375734+0000","last_undegraded":"2024-04-25T12:50:18.375734+0000","last_fullsized":"2024-04-25T12:50:18.375734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443166+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:18.443166+0000","last_peered":"2024-04-25T12:50:18.443166+0000","last_clean":"2024-04-25T12:50:18.443166+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:18.443166+0000","last_undegraded":"2024-04-25T12:50:18.443166+0000","last_fullsized":"2024-04-25T12:50:18.443166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443959+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:18.443959+0000","last_peered":"2024-04-25T12:50:18.443959+0000","last_clean":"2024-04-25T12:50:18.443959+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:18.443959+0000","last_undegraded":"2024-04-25T12:50:18.443959+0000","last_fullsized":"2024-04-25T12:50:18.443959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373924+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:18.373924+0000","last_peered":"2024-04-25T12:50:18.373924+0000","last_clean":"2024-04-25T12:50:18.373924+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:18.373924+0000","last_undegraded":"2024-04-25T12:50:18.373924+0000","last_fullsized":"2024-04-25T12:50:18.373924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193144+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:19.193144+0000","last_peered":"2024-04-25T12:50:19.193144+0000","last_clean":"2024-04-25T12:50:19.193144+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:19.193144+0000","last_undegraded":"2024-04-25T12:50:19.193144+0000","last_fullsized":"2024-04-25T12:50:19.193144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374315+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:18.374315+0000","last_peered":"2024-04-25T12:50:18.374315+0000","last_clean":"2024-04-25T12:50:18.374315+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:18.374315+0000","last_undegraded":"2024-04-25T12:50:18.374315+0000","last_fullsized":"2024-04-25T12:50:18.374315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491033+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:18.491033+0000","last_peered":"2024-04-25T12:50:18.491033+0000","last_clean":"2024-04-25T12:50:18.491033+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:18.491033+0000","last_undegraded":"2024-04-25T12:50:18.491033+0000","last_fullsized":"2024-04-25T12:50:18.491033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708733+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:18.708733+0000","last_peered":"2024-04-25T12:50:18.708733+0000","last_clean":"2024-04-25T12:50:18.708733+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:18.708733+0000","last_undegraded":"2024-04-25T12:50:18.708733+0000","last_fullsized":"2024-04-25T12:50:18.708733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373854+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:18.373854+0000","last_peered":"2024-04-25T12:50:18.373854+0000","last_clean":"2024-04-25T12:50:18.373854+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:18.373854+0000","last_undegraded":"2024-04-25T12:50:18.373854+0000","last_fullsized":"2024-04-25T12:50:18.373854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376351+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:18.376351+0000","last_peered":"2024-04-25T12:50:18.376351+0000","last_clean":"2024-04-25T12:50:18.376351+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:18.376351+0000","last_undegraded":"2024-04-25T12:50:18.376351+0000","last_fullsized":"2024-04-25T12:50:18.376351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443909+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:18.443909+0000","last_peered":"2024-04-25T12:50:18.443909+0000","last_clean":"2024-04-25T12:50:18.443909+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:18.443909+0000","last_undegraded":"2024-04-25T12:50:18.443909+0000","last_fullsized":"2024-04-25T12:50:18.443909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375492+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:18.375492+0000","last_peered":"2024-04-25T12:50:18.375492+0000","last_clean":"2024-04-25T12:50:18.375492+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:18.375492+0000","last_undegraded":"2024-04-25T12:50:18.375492+0000","last_fullsized":"2024-04-25T12:50:18.375492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443634+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:18.443634+0000","last_peered":"2024-04-25T12:50:18.443634+0000","last_clean":"2024-04-25T12:50:18.443634+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:18.443634+0000","last_undegraded":"2024-04-25T12:50:18.443634+0000","last_fullsized":"2024-04-25T12:50:18.443634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194390+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:19.194390+0000","last_peered":"2024-04-25T12:50:19.194390+0000","last_clean":"2024-04-25T12:50:19.194390+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:19.194390+0000","last_undegraded":"2024-04-25T12:50:19.194390+0000","last_fullsized":"2024-04-25T12:50:19.194390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490617+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:18.490617+0000","last_peered":"2024-04-25T12:50:18.490617+0000","last_clean":"2024-04-25T12:50:18.490617+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:18.490617+0000","last_undegraded":"2024-04-25T12:50:18.490617+0000","last_fullsized":"2024-04-25T12:50:18.490617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194216+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:19.194216+0000","last_peered":"2024-04-25T12:50:19.194216+0000","last_clean":"2024-04-25T12:50:19.194216+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:19.194216+0000","last_undegraded":"2024-04-25T12:50:19.194216+0000","last_fullsized":"2024-04-25T12:50:19.194216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443733+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:18.443733+0000","last_peered":"2024-04-25T12:50:18.443733+0000","last_clean":"2024-04-25T12:50:18.443733+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:18.443733+0000","last_undegraded":"2024-04-25T12:50:18.443733+0000","last_fullsized":"2024-04-25T12:50:18.443733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443260+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:18.443260+0000","last_peered":"2024-04-25T12:50:18.443260+0000","last_clean":"2024-04-25T12:50:18.443260+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:18.443260+0000","last_undegraded":"2024-04-25T12:50:18.443260+0000","last_fullsized":"2024-04-25T12:50:18.443260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374282+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:18.374282+0000","last_peered":"2024-04-25T12:50:18.374282+0000","last_clean":"2024-04-25T12:50:18.374282+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:18.374282+0000","last_undegraded":"2024-04-25T12:50:18.374282+0000","last_fullsized":"2024-04-25T12:50:18.374282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193689+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:19.193689+0000","last_peered":"2024-04-25T12:50:19.193689+0000","last_clean":"2024-04-25T12:50:19.193689+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:19.193689+0000","last_undegraded":"2024-04-25T12:50:19.193689+0000","last_fullsized":"2024-04-25T12:50:19.193689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443658+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:18.443658+0000","last_peered":"2024-04-25T12:50:18.443658+0000","last_clean":"2024-04-25T12:50:18.443658+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:18.443658+0000","last_undegraded":"2024-04-25T12:50:18.443658+0000","last_fullsized":"2024-04-25T12:50:18.443658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443155+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:18.443155+0000","last_peered":"2024-04-25T12:50:18.443155+0000","last_clean":"2024-04-25T12:50:18.443155+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:18.443155+0000","last_undegraded":"2024-04-25T12:50:18.443155+0000","last_fullsized":"2024-04-25T12:50:18.443155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193161+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:19.193161+0000","last_peered":"2024-04-25T12:50:19.193161+0000","last_clean":"2024-04-25T12:50:19.193161+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:19.193161+0000","last_undegraded":"2024-04-25T12:50:19.193161+0000","last_fullsized":"2024-04-25T12:50:19.193161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443997+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:18.443997+0000","last_peered":"2024-04-25T12:50:18.443997+0000","last_clean":"2024-04-25T12:50:18.443997+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:18.443997+0000","last_undegraded":"2024-04-25T12:50:18.443997+0000","last_fullsized":"2024-04-25T12:50:18.443997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490428+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:18.490428+0000","last_peered":"2024-04-25T12:50:18.490428+0000","last_clean":"2024-04-25T12:50:18.490428+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:18.490428+0000","last_undegraded":"2024-04-25T12:50:18.490428+0000","last_fullsized":"2024-04-25T12:50:18.490428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193145+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:19.193145+0000","last_peered":"2024-04-25T12:50:19.193145+0000","last_clean":"2024-04-25T12:50:19.193145+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:19.193145+0000","last_undegraded":"2024-04-25T12:50:19.193145+0000","last_fullsized":"2024-04-25T12:50:19.193145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491068+0000","last_change":"2024-04-25T12:50:17.401693+0000","last_active":"2024-04-25T12:50:18.491068+0000","last_peered":"2024-04-25T12:50:18.491068+0000","last_clean":"2024-04-25T12:50:18.491068+0000","last_became_active":"2024-04-25T12:50:17.401301+0000","last_became_peered":"2024-04-25T12:50:17.401301+0000","last_unstale":"2024-04-25T12:50:18.491068+0000","last_undegraded":"2024-04-25T12:50:18.491068+0000","last_fullsized":"2024-04-25T12:50:18.491068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:18.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375470+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:18.375470+0000","last_peered":"2024-04-25T12:50:18.375470+0000","last_clean":"2024-04-25T12:50:18.375470+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:18.375470+0000","last_undegraded":"2024-04-25T12:50:18.375470+0000","last_fullsized":"2024-04-25T12:50:18.375470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193598+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:19.193598+0000","last_peered":"2024-04-25T12:50:19.193598+0000","last_clean":"2024-04-25T12:50:19.193598+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:19.193598+0000","last_undegraded":"2024-04-25T12:50:19.193598+0000","last_fullsized":"2024-04-25T12:50:19.193598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193275+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:19.193275+0000","last_peered":"2024-04-25T12:50:19.193275+0000","last_clean":"2024-04-25T12:50:19.193275+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:19.193275+0000","last_undegraded":"2024-04-25T12:50:19.193275+0000","last_fullsized":"2024-04-25T12:50:19.193275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708408+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:18.708408+0000","last_peered":"2024-04-25T12:50:18.708408+0000","last_clean":"2024-04-25T12:50:18.708408+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:18.708408+0000","last_undegraded":"2024-04-25T12:50:18.708408+0000","last_fullsized":"2024-04-25T12:50:18.708408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193953+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:19.193953+0000","last_peered":"2024-04-25T12:50:19.193953+0000","last_clean":"2024-04-25T12:50:19.193953+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:19.193953+0000","last_undegraded":"2024-04-25T12:50:19.193953+0000","last_fullsized":"2024-04-25T12:50:19.193953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193281+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:19.193281+0000","last_peered":"2024-04-25T12:50:19.193281+0000","last_clean":"2024-04-25T12:50:19.193281+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:19.193281+0000","last_undegraded":"2024-04-25T12:50:19.193281+0000","last_fullsized":"2024-04-25T12:50:19.193281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708109+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:18.708109+0000","last_peered":"2024-04-25T12:50:18.708109+0000","last_clean":"2024-04-25T12:50:18.708109+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:18.708109+0000","last_undegraded":"2024-04-25T12:50:18.708109+0000","last_fullsized":"2024-04-25T12:50:18.708109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194752+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:19.194752+0000","last_peered":"2024-04-25T12:50:19.194752+0000","last_clean":"2024-04-25T12:50:19.194752+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:19.194752+0000","last_undegraded":"2024-04-25T12:50:19.194752+0000","last_fullsized":"2024-04-25T12:50:19.194752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443731+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:18.443731+0000","last_peered":"2024-04-25T12:50:18.443731+0000","last_clean":"2024-04-25T12:50:18.443731+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:18.443731+0000","last_undegraded":"2024-04-25T12:50:18.443731+0000","last_fullsized":"2024-04-25T12:50:18.443731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490742+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:18.490742+0000","last_peered":"2024-04-25T12:50:18.490742+0000","last_clean":"2024-04-25T12:50:18.490742+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:18.490742+0000","last_undegraded":"2024-04-25T12:50:18.490742+0000","last_fullsized":"2024-04-25T12:50:18.490742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194447+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:19.194447+0000","last_peered":"2024-04-25T12:50:19.194447+0000","last_clean":"2024-04-25T12:50:19.194447+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:19.194447+0000","last_undegraded":"2024-04-25T12:50:19.194447+0000","last_fullsized":"2024-04-25T12:50:19.194447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193280+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:19.193280+0000","last_peered":"2024-04-25T12:50:19.193280+0000","last_clean":"2024-04-25T12:50:19.193280+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:19.193280+0000","last_undegraded":"2024-04-25T12:50:19.193280+0000","last_fullsized":"2024-04-25T12:50:19.193280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193177+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:19.193177+0000","last_peered":"2024-04-25T12:50:19.193177+0000","last_clean":"2024-04-25T12:50:19.193177+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:19.193177+0000","last_undegraded":"2024-04-25T12:50:19.193177+0000","last_fullsized":"2024-04-25T12:50:19.193177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194335+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:19.194335+0000","last_peered":"2024-04-25T12:50:19.194335+0000","last_clean":"2024-04-25T12:50:19.194335+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:19.194335+0000","last_undegraded":"2024-04-25T12:50:19.194335+0000","last_fullsized":"2024-04-25T12:50:19.194335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374456+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:18.374456+0000","last_peered":"2024-04-25T12:50:18.374456+0000","last_clean":"2024-04-25T12:50:18.374456+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:18.374456+0000","last_undegraded":"2024-04-25T12:50:18.374456+0000","last_fullsized":"2024-04-25T12:50:18.374456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373647+0000","last_change":"2024-04-25T12:50:17.392618+0000","last_active":"2024-04-25T12:50:18.373647+0000","last_peered":"2024-04-25T12:50:18.373647+0000","last_clean":"2024-04-25T12:50:18.373647+0000","last_became_active":"2024-04-25T12:50:17.392252+0000","last_became_peered":"2024-04-25T12:50:17.392252+0000","last_unstale":"2024-04-25T12:50:18.373647+0000","last_undegraded":"2024-04-25T12:50:18.373647+0000","last_fullsized":"2024-04-25T12:50:18.373647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:21.181630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193639+0000","last_change":"2024-04-25T12:50:13.367452+0000","last_active":"2024-04-25T12:50:19.193639+0000","last_peered":"2024-04-25T12:50:19.193639+0000","last_clean":"2024-04-25T12:50:19.193639+0000","last_became_active":"2024-04-25T12:50:13.367191+0000","last_became_peered":"2024-04-25T12:50:13.367191+0000","last_unstale":"2024-04-25T12:50:19.193639+0000","last_undegraded":"2024-04-25T12:50:19.193639+0000","last_fullsized":"2024-04-25T12:50:19.193639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:22.674147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192881+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:19.192881+0000","last_peered":"2024-04-25T12:50:19.192881+0000","last_clean":"2024-04-25T12:50:19.192881+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:19.192881+0000","last_undegraded":"2024-04-25T12:50:19.192881+0000","last_fullsized":"2024-04-25T12:50:19.192881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490922+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:18.490922+0000","last_peered":"2024-04-25T12:50:18.490922+0000","last_clean":"2024-04-25T12:50:18.490922+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:18.490922+0000","last_undegraded":"2024-04-25T12:50:18.490922+0000","last_fullsized":"2024-04-25T12:50:18.490922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708208+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:18.708208+0000","last_peered":"2024-04-25T12:50:18.708208+0000","last_clean":"2024-04-25T12:50:18.708208+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:18.708208+0000","last_undegraded":"2024-04-25T12:50:18.708208+0000","last_fullsized":"2024-04-25T12:50:18.708208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708149+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:18.708149+0000","last_peered":"2024-04-25T12:50:18.708149+0000","last_clean":"2024-04-25T12:50:18.708149+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:18.708149+0000","last_undegraded":"2024-04-25T12:50:18.708149+0000","last_fullsized":"2024-04-25T12:50:18.708149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376312+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:18.376312+0000","last_peered":"2024-04-25T12:50:18.376312+0000","last_clean":"2024-04-25T12:50:18.376312+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:18.376312+0000","last_undegraded":"2024-04-25T12:50:18.376312+0000","last_fullsized":"2024-04-25T12:50:18.376312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194172+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:19.194172+0000","last_peered":"2024-04-25T12:50:19.194172+0000","last_clean":"2024-04-25T12:50:19.194172+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:19.194172+0000","last_undegraded":"2024-04-25T12:50:19.194172+0000","last_fullsized":"2024-04-25T12:50:19.194172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193812+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:19.193812+0000","last_peered":"2024-04-25T12:50:19.193812+0000","last_clean":"2024-04-25T12:50:19.193812+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:19.193812+0000","last_undegraded":"2024-04-25T12:50:19.193812+0000","last_fullsized":"2024-04-25T12:50:19.193812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376048+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:18.376048+0000","last_peered":"2024-04-25T12:50:18.376048+0000","last_clean":"2024-04-25T12:50:18.376048+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:18.376048+0000","last_undegraded":"2024-04-25T12:50:18.376048+0000","last_fullsized":"2024-04-25T12:50:18.376048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490628+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:18.490628+0000","last_peered":"2024-04-25T12:50:18.490628+0000","last_clean":"2024-04-25T12:50:18.490628+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:18.490628+0000","last_undegraded":"2024-04-25T12:50:18.490628+0000","last_fullsized":"2024-04-25T12:50:18.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490899+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:18.490899+0000","last_peered":"2024-04-25T12:50:18.490899+0000","last_clean":"2024-04-25T12:50:18.490899+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:18.490899+0000","last_undegraded":"2024-04-25T12:50:18.490899+0000","last_fullsized":"2024-04-25T12:50:18.490899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194059+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:19.194059+0000","last_peered":"2024-04-25T12:50:19.194059+0000","last_clean":"2024-04-25T12:50:19.194059+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:19.194059+0000","last_undegraded":"2024-04-25T12:50:19.194059+0000","last_fullsized":"2024-04-25T12:50:19.194059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193830+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:19.193830+0000","last_peered":"2024-04-25T12:50:19.193830+0000","last_clean":"2024-04-25T12:50:19.193830+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:19.193830+0000","last_undegraded":"2024-04-25T12:50:19.193830+0000","last_fullsized":"2024-04-25T12:50:19.193830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:27.695335+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:27.695335+0000","last_peered":"2024-04-25T12:50:27.695335+0000","last_clean":"2024-04-25T12:50:27.695335+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:27.695335+0000","last_undegraded":"2024-04-25T12:50:27.695335+0000","last_fullsized":"2024-04-25T12:50:27.695335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443311+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:18.443311+0000","last_peered":"2024-04-25T12:50:18.443311+0000","last_clean":"2024-04-25T12:50:18.443311+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:18.443311+0000","last_undegraded":"2024-04-25T12:50:18.443311+0000","last_fullsized":"2024-04-25T12:50:18.443311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374509+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:18.374509+0000","last_peered":"2024-04-25T12:50:18.374509+0000","last_clean":"2024-04-25T12:50:18.374509+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:18.374509+0000","last_undegraded":"2024-04-25T12:50:18.374509+0000","last_fullsized":"2024-04-25T12:50:18.374509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443678+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:18.443678+0000","last_peered":"2024-04-25T12:50:18.443678+0000","last_clean":"2024-04-25T12:50:18.443678+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:18.443678+0000","last_undegraded":"2024-04-25T12:50:18.443678+0000","last_fullsized":"2024-04-25T12:50:18.443678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374070+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:18.374070+0000","last_peered":"2024-04-25T12:50:18.374070+0000","last_clean":"2024-04-25T12:50:18.374070+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:18.374070+0000","last_undegraded":"2024-04-25T12:50:18.374070+0000","last_fullsized":"2024-04-25T12:50:18.374070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490802+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:18.490802+0000","last_peered":"2024-04-25T12:50:18.490802+0000","last_clean":"2024-04-25T12:50:18.490802+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:18.490802+0000","last_undegraded":"2024-04-25T12:50:18.490802+0000","last_fullsized":"2024-04-25T12:50:18.490802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194108+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:19.194108+0000","last_peered":"2024-04-25T12:50:19.194108+0000","last_clean":"2024-04-25T12:50:19.194108+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:19.194108+0000","last_undegraded":"2024-04-25T12:50:19.194108+0000","last_fullsized":"2024-04-25T12:50:19.194108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375750+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:18.375750+0000","last_peered":"2024-04-25T12:50:18.375750+0000","last_clean":"2024-04-25T12:50:18.375750+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:18.375750+0000","last_undegraded":"2024-04-25T12:50:18.375750+0000","last_fullsized":"2024-04-25T12:50:18.375750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194015+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:19.194015+0000","last_peered":"2024-04-25T12:50:19.194015+0000","last_clean":"2024-04-25T12:50:19.194015+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:19.194015+0000","last_undegraded":"2024-04-25T12:50:19.194015+0000","last_fullsized":"2024-04-25T12:50:19.194015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708598+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:18.708598+0000","last_peered":"2024-04-25T12:50:18.708598+0000","last_clean":"2024-04-25T12:50:18.708598+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:18.708598+0000","last_undegraded":"2024-04-25T12:50:18.708598+0000","last_fullsized":"2024-04-25T12:50:18.708598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375629+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:18.375629+0000","last_peered":"2024-04-25T12:50:18.375629+0000","last_clean":"2024-04-25T12:50:18.375629+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:18.375629+0000","last_undegraded":"2024-04-25T12:50:18.375629+0000","last_fullsized":"2024-04-25T12:50:18.375629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490933+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:18.490933+0000","last_peered":"2024-04-25T12:50:18.490933+0000","last_clean":"2024-04-25T12:50:18.490933+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:18.490933+0000","last_undegraded":"2024-04-25T12:50:18.490933+0000","last_fullsized":"2024-04-25T12:50:18.490933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443059+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:18.443059+0000","last_peered":"2024-04-25T12:50:18.443059+0000","last_clean":"2024-04-25T12:50:18.443059+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:18.443059+0000","last_undegraded":"2024-04-25T12:50:18.443059+0000","last_fullsized":"2024-04-25T12:50:18.443059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193400+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:19.193400+0000","last_peered":"2024-04-25T12:50:19.193400+0000","last_clean":"2024-04-25T12:50:19.193400+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:19.193400+0000","last_undegraded":"2024-04-25T12:50:19.193400+0000","last_fullsized":"2024-04-25T12:50:19.193400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708614+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:18.708614+0000","last_peered":"2024-04-25T12:50:18.708614+0000","last_clean":"2024-04-25T12:50:18.708614+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:18.708614+0000","last_undegraded":"2024-04-25T12:50:18.708614+0000","last_fullsized":"2024-04-25T12:50:18.708614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375619+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:18.375619+0000","last_peered":"2024-04-25T12:50:18.375619+0000","last_clean":"2024-04-25T12:50:18.375619+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:18.375619+0000","last_undegraded":"2024-04-25T12:50:18.375619+0000","last_fullsized":"2024-04-25T12:50:18.375619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375790+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:18.375790+0000","last_peered":"2024-04-25T12:50:18.375790+0000","last_clean":"2024-04-25T12:50:18.375790+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:18.375790+0000","last_undegraded":"2024-04-25T12:50:18.375790+0000","last_fullsized":"2024-04-25T12:50:18.375790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708432+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:18.708432+0000","last_peered":"2024-04-25T12:50:18.708432+0000","last_clean":"2024-04-25T12:50:18.708432+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:18.708432+0000","last_undegraded":"2024-04-25T12:50:18.708432+0000","last_fullsized":"2024-04-25T12:50:18.708432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490790+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:18.490790+0000","last_peered":"2024-04-25T12:50:18.490790+0000","last_clean":"2024-04-25T12:50:18.490790+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:18.490790+0000","last_undegraded":"2024-04-25T12:50:18.490790+0000","last_fullsized":"2024-04-25T12:50:18.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193090+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:19.193090+0000","last_peered":"2024-04-25T12:50:19.193090+0000","last_clean":"2024-04-25T12:50:19.193090+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:19.193090+0000","last_undegraded":"2024-04-25T12:50:19.193090+0000","last_fullsized":"2024-04-25T12:50:19.193090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375880+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:18.375880+0000","last_peered":"2024-04-25T12:50:18.375880+0000","last_clean":"2024-04-25T12:50:18.375880+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:18.375880+0000","last_undegraded":"2024-04-25T12:50:18.375880+0000","last_fullsized":"2024-04-25T12:50:18.375880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374019+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:18.374019+0000","last_peered":"2024-04-25T12:50:18.374019+0000","last_clean":"2024-04-25T12:50:18.374019+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:18.374019+0000","last_undegraded":"2024-04-25T12:50:18.374019+0000","last_fullsized":"2024-04-25T12:50:18.374019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375974+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:18.375974+0000","last_peered":"2024-04-25T12:50:18.375974+0000","last_clean":"2024-04-25T12:50:18.375974+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:18.375974+0000","last_undegraded":"2024-04-25T12:50:18.375974+0000","last_fullsized":"2024-04-25T12:50:18.375974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707993+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:18.707993+0000","last_peered":"2024-04-25T12:50:18.707993+0000","last_clean":"2024-04-25T12:50:18.707993+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:18.707993+0000","last_undegraded":"2024-04-25T12:50:18.707993+0000","last_fullsized":"2024-04-25T12:50:18.707993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192896+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:19.192896+0000","last_peered":"2024-04-25T12:50:19.192896+0000","last_clean":"2024-04-25T12:50:19.192896+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:19.192896+0000","last_undegraded":"2024-04-25T12:50:19.192896+0000","last_fullsized":"2024-04-25T12:50:19.192896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193566+0000","last_change":"2024-04-25T12:50:13.358445+0000","last_active":"2024-04-25T12:50:19.193566+0000","last_peered":"2024-04-25T12:50:19.193566+0000","last_clean":"2024-04-25T12:50:19.193566+0000","last_became_active":"2024-04-25T12:50:13.358182+0000","last_became_peered":"2024-04-25T12:50:13.358182+0000","last_unstale":"2024-04-25T12:50:19.193566+0000","last_undegraded":"2024-04-25T12:50:19.193566+0000","last_fullsized":"2024-04-25T12:50:19.193566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:46.419647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490749+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:18.490749+0000","last_peered":"2024-04-25T12:50:18.490749+0000","last_clean":"2024-04-25T12:50:18.490749+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:18.490749+0000","last_undegraded":"2024-04-25T12:50:18.490749+0000","last_fullsized":"2024-04-25T12:50:18.490749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376132+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:18.376132+0000","last_peered":"2024-04-25T12:50:18.376132+0000","last_clean":"2024-04-25T12:50:18.376132+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:18.376132+0000","last_undegraded":"2024-04-25T12:50:18.376132+0000","last_fullsized":"2024-04-25T12:50:18.376132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443568+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:18.443568+0000","last_peered":"2024-04-25T12:50:18.443568+0000","last_clean":"2024-04-25T12:50:18.443568+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:18.443568+0000","last_undegraded":"2024-04-25T12:50:18.443568+0000","last_fullsized":"2024-04-25T12:50:18.443568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708601+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:18.708601+0000","last_peered":"2024-04-25T12:50:18.708601+0000","last_clean":"2024-04-25T12:50:18.708601+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:18.708601+0000","last_undegraded":"2024-04-25T12:50:18.708601+0000","last_fullsized":"2024-04-25T12:50:18.708601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376259+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:18.376259+0000","last_peered":"2024-04-25T12:50:18.376259+0000","last_clean":"2024-04-25T12:50:18.376259+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:18.376259+0000","last_undegraded":"2024-04-25T12:50:18.376259+0000","last_fullsized":"2024-04-25T12:50:18.376259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193289+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:19.193289+0000","last_peered":"2024-04-25T12:50:19.193289+0000","last_clean":"2024-04-25T12:50:19.193289+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:19.193289+0000","last_undegraded":"2024-04-25T12:50:19.193289+0000","last_fullsized":"2024-04-25T12:50:19.193289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375698+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:18.375698+0000","last_peered":"2024-04-25T12:50:18.375698+0000","last_clean":"2024-04-25T12:50:18.375698+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:18.375698+0000","last_undegraded":"2024-04-25T12:50:18.375698+0000","last_fullsized":"2024-04-25T12:50:18.375698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193540+0000","last_change":"2024-04-25T12:50:13.369544+0000","last_active":"2024-04-25T12:50:19.193540+0000","last_peered":"2024-04-25T12:50:19.193540+0000","last_clean":"2024-04-25T12:50:19.193540+0000","last_became_active":"2024-04-25T12:50:13.369254+0000","last_became_peered":"2024-04-25T12:50:13.369254+0000","last_unstale":"2024-04-25T12:50:19.193540+0000","last_undegraded":"2024-04-25T12:50:19.193540+0000","last_fullsized":"2024-04-25T12:50:19.193540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:07.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490531+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:18.490531+0000","last_peered":"2024-04-25T12:50:18.490531+0000","last_clean":"2024-04-25T12:50:18.490531+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:18.490531+0000","last_undegraded":"2024-04-25T12:50:18.490531+0000","last_fullsized":"2024-04-25T12:50:18.490531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708357+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:18.708357+0000","last_peered":"2024-04-25T12:50:18.708357+0000","last_clean":"2024-04-25T12:50:18.708357+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:18.708357+0000","last_undegraded":"2024-04-25T12:50:18.708357+0000","last_fullsized":"2024-04-25T12:50:18.708357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194284+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:19.194284+0000","last_peered":"2024-04-25T12:50:19.194284+0000","last_clean":"2024-04-25T12:50:19.194284+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:19.194284+0000","last_undegraded":"2024-04-25T12:50:19.194284+0000","last_fullsized":"2024-04-25T12:50:19.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193222+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:19.193222+0000","last_peered":"2024-04-25T12:50:19.193222+0000","last_clean":"2024-04-25T12:50:19.193222+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:19.193222+0000","last_undegraded":"2024-04-25T12:50:19.193222+0000","last_fullsized":"2024-04-25T12:50:19.193222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194416+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:19.194416+0000","last_peered":"2024-04-25T12:50:19.194416+0000","last_clean":"2024-04-25T12:50:19.194416+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:19.194416+0000","last_undegraded":"2024-04-25T12:50:19.194416+0000","last_fullsized":"2024-04-25T12:50:19.194416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193130+0000","last_change":"2024-04-25T12:50:13.361730+0000","last_active":"2024-04-25T12:50:19.193130+0000","last_peered":"2024-04-25T12:50:19.193130+0000","last_clean":"2024-04-25T12:50:19.193130+0000","last_became_active":"2024-04-25T12:50:13.361305+0000","last_became_peered":"2024-04-25T12:50:13.361305+0000","last_unstale":"2024-04-25T12:50:19.193130+0000","last_undegraded":"2024-04-25T12:50:19.193130+0000","last_fullsized":"2024-04-25T12:50:19.193130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.112968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443125+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:18.443125+0000","last_peered":"2024-04-25T12:50:18.443125+0000","last_clean":"2024-04-25T12:50:18.443125+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:18.443125+0000","last_undegraded":"2024-04-25T12:50:18.443125+0000","last_fullsized":"2024-04-25T12:50:18.443125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490744+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:18.490744+0000","last_peered":"2024-04-25T12:50:18.490744+0000","last_clean":"2024-04-25T12:50:18.490744+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:18.490744+0000","last_undegraded":"2024-04-25T12:50:18.490744+0000","last_fullsized":"2024-04-25T12:50:18.490744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375678+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:18.375678+0000","last_peered":"2024-04-25T12:50:18.375678+0000","last_clean":"2024-04-25T12:50:18.375678+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:18.375678+0000","last_undegraded":"2024-04-25T12:50:18.375678+0000","last_fullsized":"2024-04-25T12:50:18.375678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374421+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:18.374421+0000","last_peered":"2024-04-25T12:50:18.374421+0000","last_clean":"2024-04-25T12:50:18.374421+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:18.374421+0000","last_undegraded":"2024-04-25T12:50:18.374421+0000","last_fullsized":"2024-04-25T12:50:18.374421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708474+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:18.708474+0000","last_peered":"2024-04-25T12:50:18.708474+0000","last_clean":"2024-04-25T12:50:18.708474+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:18.708474+0000","last_undegraded":"2024-04-25T12:50:18.708474+0000","last_fullsized":"2024-04-25T12:50:18.708474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708530+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:18.708530+0000","last_peered":"2024-04-25T12:50:18.708530+0000","last_clean":"2024-04-25T12:50:18.708530+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:18.708530+0000","last_undegraded":"2024-04-25T12:50:18.708530+0000","last_fullsized":"2024-04-25T12:50:18.708530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194342+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:19.194342+0000","last_peered":"2024-04-25T12:50:19.194342+0000","last_clean":"2024-04-25T12:50:19.194342+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:19.194342+0000","last_undegraded":"2024-04-25T12:50:19.194342+0000","last_fullsized":"2024-04-25T12:50:19.194342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375421+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:18.375421+0000","last_peered":"2024-04-25T12:50:18.375421+0000","last_clean":"2024-04-25T12:50:18.375421+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:18.375421+0000","last_undegraded":"2024-04-25T12:50:18.375421+0000","last_fullsized":"2024-04-25T12:50:18.375421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193509+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:19.193509+0000","last_peered":"2024-04-25T12:50:19.193509+0000","last_clean":"2024-04-25T12:50:19.193509+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:19.193509+0000","last_undegraded":"2024-04-25T12:50:19.193509+0000","last_fullsized":"2024-04-25T12:50:19.193509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193428+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:19.193428+0000","last_peered":"2024-04-25T12:50:19.193428+0000","last_clean":"2024-04-25T12:50:19.193428+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:19.193428+0000","last_undegraded":"2024-04-25T12:50:19.193428+0000","last_fullsized":"2024-04-25T12:50:19.193428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193961+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:19.193961+0000","last_peered":"2024-04-25T12:50:19.193961+0000","last_clean":"2024-04-25T12:50:19.193961+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:19.193961+0000","last_undegraded":"2024-04-25T12:50:19.193961+0000","last_fullsized":"2024-04-25T12:50:19.193961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194637+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:19.194637+0000","last_peered":"2024-04-25T12:50:19.194637+0000","last_clean":"2024-04-25T12:50:19.194637+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:19.194637+0000","last_undegraded":"2024-04-25T12:50:19.194637+0000","last_fullsized":"2024-04-25T12:50:19.194637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490720+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:18.490720+0000","last_peered":"2024-04-25T12:50:18.490720+0000","last_clean":"2024-04-25T12:50:18.490720+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:18.490720+0000","last_undegraded":"2024-04-25T12:50:18.490720+0000","last_fullsized":"2024-04-25T12:50:18.490720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443835+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:18.443835+0000","last_peered":"2024-04-25T12:50:18.443835+0000","last_clean":"2024-04-25T12:50:18.443835+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:18.443835+0000","last_undegraded":"2024-04-25T12:50:18.443835+0000","last_fullsized":"2024-04-25T12:50:18.443835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194154+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:19.194154+0000","last_peered":"2024-04-25T12:50:19.194154+0000","last_clean":"2024-04-25T12:50:19.194154+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:19.194154+0000","last_undegraded":"2024-04-25T12:50:19.194154+0000","last_fullsized":"2024-04-25T12:50:19.194154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542154,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":104457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":104493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":104367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:42.727 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T12:50:42.728 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T12:50:42.728 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T12:50:42.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T12:50:42.729 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T12:50:42.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.862+0000 7f1e29e20640 1 Processor -- start 2024-04-25T12:50:42.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.862+0000 7f1e29e20640 1 -- start start 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.862+0000 7f1e29e20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e2415d170 0x7f1e24159000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.862+0000 7f1e29e20640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e24153750 con 0x7f1e24153370 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.862+0000 7f1e29e20640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e240c64b0 con 0x7f1e24073890 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.862+0000 7f1e29e20640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1e2415d590 con 0x7f1e2415d170 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e237fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1e24153370 0x7f1e240c5ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36856/0 (socket says 172.21.15.132:36856) 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e22ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e2415d170 0x7f1e24159000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e237fe640 1 -- 172.21.15.132:0/585738138 learned_addr learned my addr 172.21.15.132:0/585738138 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e227fc640 1 -- 172.21.15.132:0/585738138 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842586535 0 0) 0x7f1e24153750 con 0x7f1e24153370 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e227fc640 1 -- 172.21.15.132:0/585738138 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e0c003520 con 0x7f1e24153370 2024-04-25T12:50:42.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e22ffd640 1 -- 172.21.15.132:0/585738138 >> v1:172.21.15.157:6789/0 conn(0x7f1e24073890 legacy=0x7f1e240c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e22ffd640 1 -- 172.21.15.132:0/585738138 >> v1:172.21.15.132:6789/0 conn(0x7f1e24153370 legacy=0x7f1e240c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.863+0000 7f1e22ffd640 1 -- 172.21.15.132:0/585738138 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e240c6790 con 0x7f1e2415d170 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e22ffd640 1 --2- 172.21.15.132:0/585738138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e2415d170 0x7f1e24159000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e180097a0 tx=0x7f1e1802a2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10bec89477f7f0b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e227fc640 1 -- 172.21.15.132:0/585738138 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18037070 con 0x7f1e2415d170 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e227fc640 1 -- 172.21.15.132:0/585738138 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e18032640 con 0x7f1e2415d170 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e227fc640 1 -- 172.21.15.132:0/585738138 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18032a10 con 0x7f1e2415d170 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 -- 172.21.15.132:0/585738138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e2415d170 msgr2=0x7f1e24159000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 --2- 172.21.15.132:0/585738138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e2415d170 0x7f1e24159000 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1e180097a0 tx=0x7f1e1802a2c0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 -- 172.21.15.132:0/585738138 shutdown_connections 2024-04-25T12:50:42.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 --2- 172.21.15.132:0/585738138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e2415d170 0x7f1e24159000 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 -- 172.21.15.132:0/585738138 >> 172.21.15.132:0/585738138 conn(0x7f1e24070970 msgr2=0x7f1e24070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:42.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 -- 172.21.15.132:0/585738138 shutdown_connections 2024-04-25T12:50:42.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.864+0000 7f1e29e20640 1 -- 172.21.15.132:0/585738138 wait complete. 2024-04-25T12:50:42.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.865+0000 7f1e29e20640 1 Processor -- start 2024-04-25T12:50:42.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 -- start start 2024-04-25T12:50:42.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e24073890 0x7f1e2414cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 0x7f1e2415b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e2415d170 0x7f1e241486a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2415c970 con 0x7f1e24153370 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1e2415c690 con 0x7f1e24073890 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e29e20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1e2415cc50 con 0x7f1e2415d170 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 0x7f1e2415b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e22ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 0x7f1e2415b7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51294/0 (socket says 172.21.15.132:51294) 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e22ffd640 1 -- 172.21.15.132:0/647542695 learned_addr learned my addr 172.21.15.132:0/647542695 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e237fe640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e24073890 0x7f1e2414cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.866+0000 7f1e23fff640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e2415d170 0x7f1e241486a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e22ffd640 1 -- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e2415d170 msgr2=0x7f1e241486a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e22ffd640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e2415d170 0x7f1e241486a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e22ffd640 1 -- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e24073890 msgr2=0x7f1e2414cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e22ffd640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e24073890 0x7f1e2414cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:42.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e22ffd640 1 -- 172.21.15.132:0/647542695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e241580a0 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e23fff640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e2415d170 0x7f1e241486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e237fe640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e24073890 0x7f1e2414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e22ffd640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 0x7f1e2415b7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098c0 tx=0x7f1e180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18037040 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1e18032440 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e24158380 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18030990 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.867+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e24158940 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.868+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e240cf700 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.868+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1e18044020 con 0x7f1e24153370 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.869+0000 7f1e0bfff640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1e1006c920 0x7f1e1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:42.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.869+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1e180ac120 con 0x7f1e24153370 2024-04-25T12:50:42.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.869+0000 7f1e237fe640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1e1006c920 0x7f1e1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:42.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.869+0000 7f1e237fe640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1e1006c920 0x7f1e1006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e140011e0 tx=0x7f1e14009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:42.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:42.873+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1e240cf700 con 0x7f1e24153370 2024-04-25T12:50:43.098 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.100+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f1e240741e0 con 0x7f1e24153370 2024-04-25T12:50:43.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.103+0000 7f1e0bfff640 1 -- 172.21.15.132:0/647542695 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174144 (secure 0 0 0) 0x7f1e1807a2a0 con 0x7f1e24153370 2024-04-25T12:50:43.103 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:43.104 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.105+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1e1006c920 msgr2=0x7f1e1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.105+0000 7f1e29e20640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1e1006c920 0x7f1e1006ede0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1e140011e0 tx=0x7f1e14009040 comp rx=0 tx=0).stop 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.105+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 msgr2=0x7f1e2415b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.105+0000 7f1e29e20640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 0x7f1e2415b7c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f1e180098c0 tx=0x7f1e180046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 shutdown_connections 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1e1006c920 0x7f1e1006ede0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1e2415d170 0x7f1e241486a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e24153370 0x7f1e2415b7c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 --2- 172.21.15.132:0/647542695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1e24073890 0x7f1e2414cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 >> 172.21.15.132:0/647542695 conn(0x7f1e24070970 msgr2=0x7f1e240cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 shutdown_connections 2024-04-25T12:50:43.105 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.106+0000 7f1e29e20640 1 -- 172.21.15.132:0/647542695 wait complete. 2024-04-25T12:50:43.115 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":1781084722},{"type":"v1","addr":"172.21.15.132:6833","nonce":1781084722}]},"active_addr":"172.21.15.132:6833/1781084722","active_change":"2024-04-25T12:49:53.118533+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4115,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3156949440}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3794529630}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3491276202}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1204113105}]}]} 2024-04-25T12:50:43.118 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T12:50:43.118 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T12:50:43.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:43.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.218+0000 7efe626e1640 1 Processor -- start 2024-04-25T12:50:43.216 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.218+0000 7efe626e1640 1 -- start start 2024-04-25T12:50:43.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe626e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c0c8940 0x7efe5c0ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe626e1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe5c15f350 0x7efe5c15b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe626e1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe5c0c8d20 con 0x7efe5c070870 2024-04-25T12:50:43.220 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe626e1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7efe5c15f770 con 0x7efe5c15f350 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe626e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efe5c15bb50 con 0x7efe5c0c8940 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efe5c15f350 0x7efe5c15b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe60c7e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7efe5c070870 0x7efe5c070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36860/0 (socket says 172.21.15.132:36860) 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe60c7e640 1 -- 172.21.15.132:0/1046042978 learned_addr learned my addr 172.21.15.132:0/1046042978 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5bfff640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c0c8940 0x7efe5c0ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5b7fe640 1 -- 172.21.15.132:0/1046042978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c0c8940 msgr2=0x7efe5c0ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.221 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5b7fe640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c0c8940 0x7efe5c0ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5b7fe640 1 -- 172.21.15.132:0/1046042978 >> v1:172.21.15.132:6789/0 conn(0x7efe5c070870 legacy=0x7efe5c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5b7fe640 1 -- 172.21.15.132:0/1046042978 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c15be30 con 0x7efe5c15f350 2024-04-25T12:50:43.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.219+0000 7efe5bfff640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c0c8940 0x7efe5c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:43.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe5b7fe640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c15f350 0x7efe5c15b1e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efe500097a0 tx=0x7efe5002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3518b14a7bdd18cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.222 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe5affd640 1 -- 172.21.15.132:0/1046042978 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50037070 con 0x7efe5c15f350 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe5affd640 1 -- 172.21.15.132:0/1046042978 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5002ae50 con 0x7efe5c15f350 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe5affd640 1 -- 172.21.15.132:0/1046042978 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50032660 con 0x7efe5c15f350 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe626e1640 1 -- 172.21.15.132:0/1046042978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c15f350 msgr2=0x7efe5c15b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe626e1640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c15f350 0x7efe5c15b1e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7efe500097a0 tx=0x7efe5002a100 comp rx=0 tx=0).stop 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe626e1640 1 -- 172.21.15.132:0/1046042978 shutdown_connections 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe626e1640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c15f350 0x7efe5c15b1e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.223 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe626e1640 1 --2- 172.21.15.132:0/1046042978 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c0c8940 0x7efe5c0ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.220+0000 7efe626e1640 1 -- 172.21.15.132:0/1046042978 >> 172.21.15.132:0/1046042978 conn(0x7efe5c067630 msgr2=0x7efe5c067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.221+0000 7efe626e1640 1 -- 172.21.15.132:0/1046042978 shutdown_connections 2024-04-25T12:50:43.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.221+0000 7efe626e1640 1 -- 172.21.15.132:0/1046042978 wait complete. 2024-04-25T12:50:43.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 Processor -- start 2024-04-25T12:50:43.224 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 -- start start 2024-04-25T12:50:43.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c070870 0x7efe5c150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 0x7efe5c1f2400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe5c15f350 0x7efe5c15a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.230 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c15eb50 con 0x7efe5c0c8940 2024-04-25T12:50:43.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efe5c15e870 con 0x7efe5c15f350 2024-04-25T12:50:43.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.222+0000 7efe626e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efe5c15ee30 con 0x7efe5c070870 2024-04-25T12:50:43.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 0x7efe5c1f2400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 0x7efe5c1f2400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51312/0 (socket says 172.21.15.132:51312) 2024-04-25T12:50:43.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 -- 172.21.15.132:0/284122401 learned_addr learned my addr 172.21.15.132:0/284122401 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5bfff640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c070870 0x7efe5c150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe60c7e640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe5c15f350 0x7efe5c15a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 -- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c070870 msgr2=0x7efe5c150500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c070870 0x7efe5c150500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 -- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe5c15f350 msgr2=0x7efe5c15a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe5c15f350 0x7efe5c15a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 -- 172.21.15.132:0/284122401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe5c1f1ab0 con 0x7efe5c0c8940 2024-04-25T12:50:43.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe60c7e640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe5c15f350 0x7efe5c15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:43.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe5b7fe640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 0x7efe5c1f2400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe500098c0 tx=0x7efe500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50041020 con 0x7efe5c0c8940 2024-04-25T12:50:43.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe5003c670 con 0x7efe5c0c8940 2024-04-25T12:50:43.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe5c1f1d90 con 0x7efe5c0c8940 2024-04-25T12:50:43.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50037040 con 0x7efe5c0c8940 2024-04-25T12:50:43.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.223+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe5c14fd00 con 0x7efe5c0c8940 2024-04-25T12:50:43.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.224+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe5c154f90 con 0x7efe5c0c8940 2024-04-25T12:50:43.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.225+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efe50044020 con 0x7efe5c0c8940 2024-04-25T12:50:43.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.225+0000 7efe58ff9640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efe4806c920 0x7efe4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.234 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.225+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efe500ac5c0 con 0x7efe5c0c8940 2024-04-25T12:50:43.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.225+0000 7efe5bfff640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efe4806c920 0x7efe4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.225+0000 7efe5bfff640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efe4806c920 0x7efe4806ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00a990 tx=0x7efe4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.229+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efe5c154f90 con 0x7efe5c0c8940 2024-04-25T12:50:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.404+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efe5c15e210 con 0x7efe5c0c8940 2024-04-25T12:50:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.405+0000 7efe58ff9640 1 -- 172.21.15.132:0/284122401 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7efe5c15e210 con 0x7efe5c0c8940 2024-04-25T12:50:43.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:43.404 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efe4806c920 msgr2=0x7efe4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efe4806c920 0x7efe4806ede0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7efe4c00a990 tx=0x7efe4c008040 comp rx=0 tx=0).stop 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 msgr2=0x7efe5c1f2400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 0x7efe5c1f2400 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7efe500098c0 tx=0x7efe500046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 shutdown_connections 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efe4806c920 0x7efe4806ede0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efe5c15f350 0x7efe5c15a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.406 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe5c0c8940 0x7efe5c1f2400 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 --2- 172.21.15.132:0/284122401 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efe5c070870 0x7efe5c150500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.407+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 >> 172.21.15.132:0/284122401 conn(0x7efe5c067630 msgr2=0x7efe5c067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.408+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 shutdown_connections 2024-04-25T12:50:43.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.408+0000 7efe626e1640 1 -- 172.21.15.132:0/284122401 wait complete. 2024-04-25T12:50:43.417 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T12:50:43.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:43.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.516+0000 7f77b01bb640 1 Processor -- start 2024-04-25T12:50:43.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.516+0000 7f77b01bb640 1 -- start start 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77b01bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f77a815b570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77b01bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a815f610 con 0x7f77a8155340 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77b01bb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77a80c7ea0 con 0x7f77a815b120 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77b01bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f77a80c8ff0 con 0x7f77a80c9b90 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77adf57640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f77a8155340 0x7f77a80c7790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36876/0 (socket says 172.21.15.132:36876) 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77adf57640 1 -- 172.21.15.132:0/105334664 learned_addr learned my addr 172.21.15.132:0/105334664 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77ae758640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f77a815b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597301069 0 0) 0x7f77a815f610 con 0x7f77a8155340 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7794003520 con 0x7f77a8155340 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2213675532 0 0) 0x7f77a80c7ea0 con 0x7f77a815b120 2024-04-25T12:50:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77a815f610 con 0x7f77a815b120 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3284769243 0 0) 0x7f7794003520 con 0x7f77a8155340 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 msgr2=0x7f77a815b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f77a815b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 >> v1:172.21.15.157:6789/0 conn(0x7f77a815b120 legacy=0x7f77a80c9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a815eab0 con 0x7f77a8155340 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f77a4001670 con 0x7f77a8155340 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77ae758640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f77a815b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 >> v1:172.21.15.132:6789/0 conn(0x7f77a8155340 legacy=0x7f77a80c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7794003b70 0x7f7794003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f7794004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7794004d40 0x7f77940051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77a80c8ff0 con 0x7f7794003b70 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f779400ba70 con 0x7f7794004d40 2024-04-25T12:50:43.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.517+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f779400bc70 con 0x7f77a80c9b90 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7794003b70 0x7f7794003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77ae758640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7794004d40 0x7f77940051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77ad756640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f7794004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 -- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 msgr2=0x7f7794004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f77a80c9b90 0x7f7794004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 -- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7794004d40 msgr2=0x7f77940051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7794004d40 0x7f77940051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 -- 172.21.15.132:0/105334664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7794003520 con 0x7f7794003b70 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.518+0000 7f77adf57640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7794003b70 0x7f7794003f70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f77a400c0e0 tx=0x7f7794005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f491671119e0a0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4007c40 con 0x7f7794003b70 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a4005ad0 con 0x7f7794003b70 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77acf55640 1 -- 172.21.15.132:0/105334664 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a4007070 con 0x7f7794003b70 2024-04-25T12:50:43.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77b01bb640 1 -- 172.21.15.132:0/105334664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7794003b70 msgr2=0x7f7794003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77b01bb640 1 --2- 172.21.15.132:0/105334664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7794003b70 0x7f7794003f70 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f77a400c0e0 tx=0x7f7794005830 comp rx=0 tx=0).stop 2024-04-25T12:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77ae758640 1 -- 172.21.15.132:0/105334664 reap_dead start 2024-04-25T12:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77b01bb640 1 -- 172.21.15.132:0/105334664 shutdown_connections 2024-04-25T12:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77b01bb640 1 -- 172.21.15.132:0/105334664 >> 172.21.15.132:0/105334664 conn(0x7f77a8067630 msgr2=0x7f77a8067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77b01bb640 1 -- 172.21.15.132:0/105334664 shutdown_connections 2024-04-25T12:50:43.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.519+0000 7f77b01bb640 1 -- 172.21.15.132:0/105334664 wait complete. 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.520+0000 7f77b01bb640 1 Processor -- start 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.520+0000 7f77b01bb640 1 -- start start 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77b01bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7794003b70 0x7f77a8148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77b01bb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77a80cb900 0x7f77a806e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77b01bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 0x7f77a806eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77b01bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f77a815f330 con 0x7f77a81e7080 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77b01bb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f77a815f050 con 0x7f77a80cb900 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77b01bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f77a815bde0 con 0x7f7794003b70 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 0x7f77a806eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 0x7f77a806eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51344/0 (socket says 172.21.15.132:51344) 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 -- 172.21.15.132:0/2472937070 learned_addr learned my addr 172.21.15.132:0/2472937070 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ad756640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77a80cb900 0x7f77a806e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77adf57640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7794003b70 0x7f77a8148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 -- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7794003b70 msgr2=0x7f77a8148430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7794003b70 0x7f77a8148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 -- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77a80cb900 msgr2=0x7f77a806e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77a80cb900 0x7f77a806e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ae758640 1 -- 172.21.15.132:0/2472937070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77a8140b00 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.521+0000 7f77ad756640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77a80cb900 0x7f77a806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.522+0000 7f77ae758640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 0x7f77a806eb40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f77a80c71a0 tx=0x7f77a000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.522+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0009e20 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.522+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a000fdc0 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.522+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77a8140de0 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.522+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0003bd0 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.522+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77a80cae20 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.523+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77a8068c20 con 0x7f77a81e7080 2024-04-25T12:50:43.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.523+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77a001f020 con 0x7f77a81e7080 2024-04-25T12:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.523+0000 7f779e7fc640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f778c06c920 0x7f778c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.524+0000 7f77adf57640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f778c06c920 0x7f778c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.524+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f77a008c0f0 con 0x7f77a81e7080 2024-04-25T12:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.524+0000 7f77adf57640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f778c06c920 0x7f778c06ede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77a4032000 tx=0x7f77a402d000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.528+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77a0010040 con 0x7f77a81e7080 2024-04-25T12:50:43.699 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.701+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f77a814a3c0 con 0x7f77a81e7080 2024-04-25T12:50:43.700 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.702+0000 7f779e7fc640 1 -- 172.21.15.132:0/2472937070 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f77a005a1e0 con 0x7f77a81e7080 2024-04-25T12:50:43.701 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:43.701 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.704+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f778c06c920 msgr2=0x7f778c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.704+0000 7f77b01bb640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f778c06c920 0x7f778c06ede0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f77a4032000 tx=0x7f77a402d000 comp rx=0 tx=0).stop 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.704+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 msgr2=0x7f77a806eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.704+0000 7f77b01bb640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 0x7f77a806eb40 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f77a80c71a0 tx=0x7f77a000f580 comp rx=0 tx=0).stop 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 shutdown_connections 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f778c06c920 0x7f778c06ede0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77a81e7080 0x7f77a806eb40 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f77a80cb900 0x7f77a806e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 --2- 172.21.15.132:0/2472937070 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7794003b70 0x7f77a8148430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 >> 172.21.15.132:0/2472937070 conn(0x7f77a8067630 msgr2=0x7f77a814abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 shutdown_connections 2024-04-25T12:50:43.704 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.705+0000 7f77b01bb640 1 -- 172.21.15.132:0/2472937070 wait complete. 2024-04-25T12:50:43.714 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T12:50:43.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T12:50:43.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T12:50:43.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T12:50:43.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T12:50:43.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T12:50:43.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-25T12:50:43.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-25T12:50:43.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.884+0000 7fd64a860640 1 Processor -- start 2024-04-25T12:50:43.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.884+0000 7fd45ecbe640 1 Processor -- start 2024-04-25T12:50:43.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.884+0000 7fd64a860640 1 -- start start 2024-04-25T12:50:43.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.884+0000 7fd45ecbe640 1 -- start start 2024-04-25T12:50:43.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7f55aa6a0640 1 Processor -- start 2024-04-25T12:50:43.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7f55aa6a0640 1 -- start start 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7fd45ecbe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4500dd390 0x7fd450046430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7fd45ecbe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd4500e3770 0x7fd45004be50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7fd45ecbe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4500dd770 con 0x7fd45004ba30 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7fd45ecbe640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd450045420 con 0x7fd4500dd390 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7fd45ecbe640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd450045fa0 con 0x7fd4500e3770 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.885+0000 7fd64a860640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd63c0452c0 0x7fd63c0456f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64a860640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd63c0e6760 0x7fd63c0e6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64a860640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd63c045c30 con 0x7fd63c0dd440 2024-04-25T12:50:43.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64a860640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd63c007640 con 0x7fd63c0e6760 2024-04-25T12:50:43.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64a860640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd63c006a30 con 0x7fd63c0452c0 2024-04-25T12:50:43.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd45dcbc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4500dd390 0x7fd450046430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd45dcbc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd4500dd390 0x7fd450046430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51346/0 (socket says 172.21.15.132:51346) 2024-04-25T12:50:43.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd45dcbc640 1 -- 172.21.15.132:0/792653135 learned_addr learned my addr 172.21.15.132:0/792653135 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7f55aa6a0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f55a4155500 0x7f55a415bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7f55aa6a0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f55a40c61a0 0x7f55a40c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7f55aa6a0640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55a415c1f0 con 0x7f55a40cb330 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7f55aa6a0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f55a415f1f0 con 0x7f55a40c61a0 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7f55aa6a0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f55a40ccc50 con 0x7f55a4155500 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd45e4bd640 1 --2- 172.21.15.132:0/792653135 >> v2:172.21.15.157:3300/0 conn(0x7fd4500e3770 0x7fd45004be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd63c0452c0 0x7fd63c0456f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd63c0452c0 0x7fd63c0456f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39566/0 (socket says 172.21.15.132:39566) 2024-04-25T12:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 -- 172.21.15.132:0/933772911 learned_addr learned my addr 172.21.15.132:0/933772911 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fa20b80b640 1 Processor -- start 2024-04-25T12:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fa20b80b640 1 -- start start 2024-04-25T12:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7f1ffdb07640 1 Processor -- start 2024-04-25T12:50:43.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 -- 172.21.15.132:0/933772911 >> v2:172.21.15.132:3300/0 conn(0x7fd63c0e6760 msgr2=0x7fd63c0e6bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 --2- 172.21.15.132:0/933772911 >> v2:172.21.15.132:3300/0 conn(0x7fd63c0e6760 0x7fd63c0e6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 -- 172.21.15.132:0/933772911 >> v1:172.21.15.132:6789/0 conn(0x7fd63c0dd440 legacy=0x7fd63c04b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.886+0000 7fd64905d640 1 -- 172.21.15.132:0/933772911 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c006d10 con 0x7fd63c0452c0 2024-04-25T12:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7f55a37fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f55a40cb330 0x7f55a40cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60750/0 (socket says 172.21.15.132:60750) 2024-04-25T12:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7f55a37fe640 1 -- 172.21.15.132:0/2968650198 learned_addr learned my addr 172.21.15.132:0/2968650198 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:43.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7f55a3fff640 1 --2- 172.21.15.132:0/2968650198 >> v2:172.21.15.157:3300/0 conn(0x7f55a4155500 0x7f55a415bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7f1ffdb07640 1 -- start start 2024-04-25T12:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7f55a2ffd640 1 -- 172.21.15.132:0/2968650198 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3843151036 0 0) 0x7f5598001110 con 0x7f55a40cb330 2024-04-25T12:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7fd45dcbc640 1 -- 172.21.15.132:0/792653135 >> v2:172.21.15.157:3300/0 conn(0x7fd4500e3770 msgr2=0x7fd45004be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7fd45dcbc640 1 --2- 172.21.15.132:0/792653135 >> v2:172.21.15.157:3300/0 conn(0x7fd4500e3770 0x7fd45004be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7fd45dcbc640 1 -- 172.21.15.132:0/792653135 >> v1:172.21.15.132:6789/0 conn(0x7fd45004ba30 legacy=0x7fd4500e3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.887+0000 7fd45dcbc640 1 -- 172.21.15.132:0/792653135 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4500e3ba0 con 0x7fd4500dd390 2024-04-25T12:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f55a2ffd640 1 -- 172.21.15.132:0/2968650198 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f558c003520 con 0x7f55a40cb330 2024-04-25T12:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fd64905d640 1 --2- 172.21.15.132:0/933772911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0452c0 0x7fd63c0456f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd644051690 tx=0x7fd6440a69f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8bb80bde9148a4ad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa20b80b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa20415eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fd64885c640 1 -- 172.21.15.132:0/933772911 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6440af070 con 0x7fd63c0452c0 2024-04-25T12:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa20b80b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20415f530 con 0x7fa204154ff0 2024-04-25T12:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f688d994640 1 Processor -- start 2024-04-25T12:50:43.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f688d994640 1 -- start start 2024-04-25T12:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa20b80b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa20415b3d0 con 0x7fa2040d0800 2024-04-25T12:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa208da6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa20415eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ffdb07640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff80cb330 0x7f1ff80cc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ffdb07640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ff80c61a0 0x7f1ff80c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ffdb07640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ff80c5f50 con 0x7f1ff8155500 2024-04-25T12:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ffdb07640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1ff815f1f0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ffdb07640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff80c5c70 con 0x7f1ff80cb330 2024-04-25T12:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa208da6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa20415eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:54912/0 (socket says 172.21.15.132:54912) 2024-04-25T12:50:43.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fd64885c640 1 -- 172.21.15.132:0/933772911 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6440ab950 con 0x7fd63c0452c0 2024-04-25T12:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fd64885c640 1 -- 172.21.15.132:0/933772911 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6440abdc0 con 0x7fd63c0452c0 2024-04-25T12:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ff80c61a0 0x7f1ff80c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ff77fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f1ff8155500 0x7f1ff815bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60752/0 (socket says 172.21.15.132:60752) 2024-04-25T12:50:43.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ff77fe640 1 -- 172.21.15.132:0/718500229 learned_addr learned my addr 172.21.15.132:0/718500229 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1ff80c61a0 0x7f1ff80c6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39584/0 (socket says 172.21.15.132:39584) 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f1feffff640 1 --2- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff80cb330 0x7f1ff80cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f1ff7fff640 1 -- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff80cb330 msgr2=0x7f1ff80cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f55a3fff640 1 -- 172.21.15.132:0/2968650198 >> v2:172.21.15.132:3300/0 conn(0x7f55a40c61a0 msgr2=0x7f55a40c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f55a3fff640 1 --2- 172.21.15.132:0/2968650198 >> v2:172.21.15.132:3300/0 conn(0x7f55a40c61a0 0x7f55a40c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f55a3fff640 1 -- 172.21.15.132:0/2968650198 >> v1:172.21.15.157:6789/0 conn(0x7f55a40cb330 legacy=0x7f55a40cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7f55a3fff640 1 -- 172.21.15.132:0/2968650198 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a40c5f50 con 0x7f55a4155500 2024-04-25T12:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f1ff7fff640 1 --2- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff80cb330 0x7f1ff80cc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f1ff7fff640 1 -- 172.21.15.132:0/718500229 >> v1:172.21.15.157:6789/0 conn(0x7f1ff8155500 legacy=0x7f1ff815bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fd45dcbc640 1 --2- 172.21.15.132:0/792653135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500dd390 0x7fd450046430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd45004e000 tx=0x7fd45402a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd1ae3296c23aff server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f8af2cfb640 1 Processor -- start 2024-04-25T12:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f55a3fff640 1 --2- 172.21.15.132:0/2968650198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a4155500 0x7f55a415bcb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55a40ce170 tx=0x7f559c02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a770f1d8326a2961 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f1ff7fff640 1 -- 172.21.15.132:0/718500229 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff815e8c0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa208da6640 1 -- 172.21.15.132:0/2364350719 learned_addr learned my addr 172.21.15.132:0/2364350719 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.888+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818442298 0 0) 0x7fa20415f530 con 0x7fa204154ff0 2024-04-25T12:50:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fd45ccba640 1 -- 172.21.15.132:0/792653135 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454037070 con 0x7fd4500dd390 2024-04-25T12:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f55a2ffd640 1 -- 172.21.15.132:0/2968650198 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c007740 con 0x7f55a4155500 2024-04-25T12:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fd45ccba640 1 -- 172.21.15.132:0/792653135 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd454032440 con 0x7fd4500dd390 2024-04-25T12:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f688d994640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888160010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f688d994640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6888160c30 0x7f6888161080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f688d994640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68880c7ed0 con 0x7f6888159880 2024-04-25T12:50:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f688d994640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6888162b80 con 0x7f6888160c30 2024-04-25T12:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f688d994640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f68881639e0 con 0x7f68880c75c0 2024-04-25T12:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f55a2ffd640 1 -- 172.21.15.132:0/2968650198 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f559c0078e0 con 0x7f55a4155500 2024-04-25T12:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f8af2cfb640 1 -- start start 2024-04-25T12:50:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f55a2ffd640 1 -- 172.21.15.132:0/2968650198 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f559c007cf0 con 0x7f55a4155500 2024-04-25T12:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f68877fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6888160c30 0x7f6888161080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f68877fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6888160c30 0x7f6888161080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39600/0 (socket says 172.21.15.132:39600) 2024-04-25T12:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f68877fe640 1 -- 172.21.15.132:0/2379793696 learned_addr learned my addr 172.21.15.132:0/2379793696 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7f68867fc640 1 --2- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888160010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fd64a860640 1 -- 172.21.15.132:0/933772911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0452c0 msgr2=0x7fd63c0456f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fd64a860640 1 --2- 172.21.15.132:0/933772911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0452c0 0x7fd63c0456f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fd644051690 tx=0x7fd6440a69f0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fa20b80b640 1 -- 172.21.15.132:0/2364350719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa20415b6b0 con 0x7fa20415ebb0 2024-04-25T12:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.889+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1f0003520 con 0x7fa204154ff0 2024-04-25T12:50:43.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f1ff7fff640 1 --2- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80c61a0 0x7f1ff80c6630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009dc0 tx=0x7f1ff002a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60b79977689becd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd64a860640 1 -- 172.21.15.132:0/933772911 shutdown_connections 2024-04-25T12:50:43.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd64a860640 1 --2- 172.21.15.132:0/933772911 >> v2:172.21.15.132:3300/0 conn(0x7fd63c0e6760 0x7fd63c0e6bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd64a860640 1 --2- 172.21.15.132:0/933772911 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0452c0 0x7fd63c0456f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd64a860640 1 -- 172.21.15.132:0/933772911 >> 172.21.15.132:0/933772911 conn(0x7fd63c050170 msgr2=0x7fd63c050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364504041 0 0) 0x7fa20415b3d0 con 0x7fa2040d0800 2024-04-25T12:50:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa20415f530 con 0x7fa2040d0800 2024-04-25T12:50:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584864182 0 0) 0x7fa1f0003520 con 0x7fa204154ff0 2024-04-25T12:50:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 msgr2=0x7fa20415eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa20415eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ecbe640 1 -- 172.21.15.132:0/792653135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500dd390 msgr2=0x7fd450046430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 >> v1:172.21.15.157:6789/0 conn(0x7fa2040d0800 legacy=0x7fa2040d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ccba640 1 -- 172.21.15.132:0/792653135 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454037070 con 0x7fd4500dd390 2024-04-25T12:50:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/792653135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500dd390 0x7fd450046430 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd45004e000 tx=0x7fd45402a2a0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af2cfb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8aec0c8f80 0x7f8aec0ccad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f55aa6a0640 1 -- 172.21.15.132:0/2968650198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a4155500 msgr2=0x7f55a415bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f55aa6a0640 1 --2- 172.21.15.132:0/2968650198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a4155500 0x7f55a415bcb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55a40ce170 tx=0x7f559c02a6a0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af2cfb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec0c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa20415b990 con 0x7fa204154ff0 2024-04-25T12:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af2cfb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8aec0cd160 con 0x7f8aec159660 2024-04-25T12:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af2cfb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8aec0718c0 con 0x7f8aec0c8f80 2024-04-25T12:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f55aa6a0640 1 -- 172.21.15.132:0/2968650198 shutdown_connections 2024-04-25T12:50:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f55aa6a0640 1 --2- 172.21.15.132:0/2968650198 >> v2:172.21.15.132:3300/0 conn(0x7f55a40c61a0 0x7f55a40c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f55aa6a0640 1 --2- 172.21.15.132:0/2968650198 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a4155500 0x7f55a415bcb0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f55a40ce170 tx=0x7f559c02a6a0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af2cfb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec072a80 con 0x7f8aec0725f0 2024-04-25T12:50:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f55aa6a0640 1 -- 172.21.15.132:0/2968650198 >> 172.21.15.132:0/2968650198 conn(0x7f55a4067c60 msgr2=0x7f55a4072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ecbe640 1 -- 172.21.15.132:0/792653135 shutdown_connections 2024-04-25T12:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/792653135 >> v2:172.21.15.157:3300/0 conn(0x7fd4500e3770 0x7fd45004be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/792653135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500dd390 0x7fd450046430 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fd45ecbe640 1 -- 172.21.15.132:0/792653135 >> 172.21.15.132:0/792653135 conn(0x7fd450050150 msgr2=0x7fd450050560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f1ff6ffd640 1 -- 172.21.15.132:0/718500229 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0007740 con 0x7f1ff80c61a0 2024-04-25T12:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7fa1f4001670 con 0x7fa204154ff0 2024-04-25T12:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 >> v1:172.21.15.132:6789/0 conn(0x7fa204154ff0 legacy=0x7fa2040cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fd45ecbe640 1 -- 172.21.15.132:0/792653135 shutdown_connections 2024-04-25T12:50:43.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af24fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec0c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa1fbfff640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa1f0004c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af24fa640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec0c7830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:54954/0 (socket says 172.21.15.132:54954) 2024-04-25T12:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f8af24fa640 1 -- 172.21.15.132:0/724750838 learned_addr learned my addr 172.21.15.132:0/724750838 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fd45ecbe640 1 -- 172.21.15.132:0/792653135 wait complete. 2024-04-25T12:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f1ff6ffd640 1 -- 172.21.15.132:0/718500229 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ff00078e0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f1ff6ffd640 1 -- 172.21.15.132:0/718500229 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff0007cb0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f8af14f8640 1 --2- 172.21.15.132:0/724750838 >> v2:172.21.15.157:3300/0 conn(0x7f8aec0c8f80 0x7f8aec0ccad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f68877fe640 1 -- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 msgr2=0x7f6888160010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f68877fe640 1 --2- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888160010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f68877fe640 1 -- 172.21.15.132:0/2379793696 >> v1:172.21.15.132:6789/0 conn(0x7f6888159880 legacy=0x7f68880c8fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.890+0000 7f68877fe640 1 -- 172.21.15.132:0/2379793696 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68881615c0 con 0x7f6888160c30 2024-04-25T12:50:43.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa1fbfff640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0005140 0x7fa1f00037a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f55aa6a0640 1 -- 172.21.15.132:0/2968650198 shutdown_connections 2024-04-25T12:50:43.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fd64a860640 1 -- 172.21.15.132:0/933772911 shutdown_connections 2024-04-25T12:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa2095a7640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa1f0004c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa208da6640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0005140 0x7fa1f00037a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa1fbfff640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f0003ce0 0x7fa1f0004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa20415b6b0 con 0x7fa1f0005140 2024-04-25T12:50:43.915 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f68877fe640 1 --2- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 0x7f6888161080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f68880c80a0 tx=0x7f688002a6b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c95f86b4978eacb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f000baa0 con 0x7fa1f0003ce0 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f000bca0 con 0x7fa20415ebb0 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fa208da6640 1 -- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 msgr2=0x7fa1f0004c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fa208da6640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20415ebb0 0x7fa1f0004c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fa208da6640 1 -- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f0003ce0 msgr2=0x7fa1f0004160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fa208da6640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa1f0003ce0 0x7fa1f0004160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fa208da6640 1 -- 172.21.15.132:0/2364350719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f0003520 con 0x7fa1f0005140 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f6885ffb640 1 -- 172.21.15.132:0/2379793696 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6880036070 con 0x7f6888160c30 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f6885ffb640 1 -- 172.21.15.132:0/2379793696 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6880031600 con 0x7f6888160c30 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f6885ffb640 1 -- 172.21.15.132:0/2379793696 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68800319d0 con 0x7f6888160c30 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f8af24fa640 1 -- 172.21.15.132:0/724750838 >> v2:172.21.15.157:3300/0 conn(0x7f8aec0c8f80 msgr2=0x7f8aec0ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f8af24fa640 1 --2- 172.21.15.132:0/724750838 >> v2:172.21.15.157:3300/0 conn(0x7f8aec0c8f80 0x7f8aec0ccad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f8af24fa640 1 -- 172.21.15.132:0/724750838 >> v1:172.21.15.157:6789/0 conn(0x7f8aec159660 legacy=0x7f8aec15fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f8af24fa640 1 -- 172.21.15.132:0/724750838 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec0cd400 con 0x7f8aec0725f0 2024-04-25T12:50:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7fd64a860640 1 -- 172.21.15.132:0/933772911 wait complete. 2024-04-25T12:50:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f8af24fa640 1 --2- 172.21.15.132:0/724750838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec0c7830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8aec071a40 tx=0x7f8ae002a270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d4ac921bc8cf6b7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f1ffdb07640 1 -- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80c61a0 msgr2=0x7f1ff80c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f1ffdb07640 1 --2- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80c61a0 0x7f1ff80c6630 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1ff0009dc0 tx=0x7f1ff002a710 comp rx=0 tx=0).stop 2024-04-25T12:50:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.891+0000 7f55aa6a0640 1 -- 172.21.15.132:0/2968650198 wait complete. 2024-04-25T12:50:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f1ffdb07640 1 -- 172.21.15.132:0/718500229 shutdown_connections 2024-04-25T12:50:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f1ffdb07640 1 --2- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80c61a0 0x7f1ff80c6630 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f1ffdb07640 1 --2- 172.21.15.132:0/718500229 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff80cb330 0x7f1ff80cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f1ffdb07640 1 -- 172.21.15.132:0/718500229 >> 172.21.15.132:0/718500229 conn(0x7f1ff8067c60 msgr2=0x7f1ff8072d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fd45ecbe640 1 Processor -- start 2024-04-25T12:50:43.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7fd45ecbe640 1 -- start start 2024-04-25T12:50:43.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.892+0000 7f55aa6a0640 1 Processor -- start 2024-04-25T12:50:43.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 Processor -- start 2024-04-25T12:50:43.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 -- start start 2024-04-25T12:50:43.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fa208da6640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0005140 0x7fa1f00037a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa20000e190 tx=0x7fa1f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70f6e6be7f73eaaf server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7f8af0cf7640 1 -- 172.21.15.132:0/724750838 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0037070 con 0x7f8aec0725f0 2024-04-25T12:50:43.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7f8af0cf7640 1 -- 172.21.15.132:0/724750838 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae0032440 con 0x7f8aec0725f0 2024-04-25T12:50:43.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7f8af0cf7640 1 -- 172.21.15.132:0/724750838 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae0032810 con 0x7f8aec0725f0 2024-04-25T12:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fc3f1c59640 1 Processor -- start 2024-04-25T12:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fc3f1c59640 1 -- start start 2024-04-25T12:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200036070 con 0x7fa1f0005140 2024-04-25T12:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa20002d070 con 0x7fa1f0005140 2024-04-25T12:50:43.922 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fa1fbfff640 1 -- 172.21.15.132:0/2364350719 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa200009cb0 con 0x7fa1f0005140 2024-04-25T12:50:43.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd63c0452c0 0x7fd63c0dfe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd63c0dd440 0x7fd63c182cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0e6760 0x7fd63c0e3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7f688d994640 1 -- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 msgr2=0x7f6888161080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.923 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 --2- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 0x7f6888161080 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f68880c80a0 tx=0x7f688002a6b0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c0dd820 con 0x7fd63c0452c0 2024-04-25T12:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7fd64a860640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd63c0072d0 con 0x7fd63c0e6760 2024-04-25T12:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64a860640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd63c04c6f0 con 0x7fd63c0dd440 2024-04-25T12:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 -- 172.21.15.132:0/2379793696 shutdown_connections 2024-04-25T12:50:43.924 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7f1ffdb07640 1 -- 172.21.15.132:0/718500229 shutdown_connections 2024-04-25T12:50:43.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 --2- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 0x7f6888161080 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 --2- 172.21.15.132:0/2379793696 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888160010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 -- 172.21.15.132:0/2379793696 >> 172.21.15.132:0/2379793696 conn(0x7f6888075db0 msgr2=0x7f6888067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.893+0000 7f55aa6a0640 1 -- start start 2024-04-25T12:50:43.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 -- 172.21.15.132:0/2379793696 shutdown_connections 2024-04-25T12:50:43.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f8af2cfb640 1 -- 172.21.15.132:0/724750838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 msgr2=0x7f8aec0c7830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/724750838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec0c7830 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8aec071a40 tx=0x7f8ae002a270 comp rx=0 tx=0).stop 2024-04-25T12:50:43.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f688d994640 1 -- 172.21.15.132:0/2379793696 wait complete. 2024-04-25T12:50:43.926 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64905d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd63c0dd440 0x7fd63c182cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64a05f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0e6760 0x7fd63c0e3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64985e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd63c0452c0 0x7fd63c0dfe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd45ecbe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd45004ba30 0x7fd4500e2910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55aa6a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55a40c61a0 0x7f55a40c9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64a05f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0e6760 0x7fd63c0e3450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39614/0 (socket says 172.21.15.132:39614) 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64a05f640 1 -- 172.21.15.132:0/1015118074 learned_addr learned my addr 172.21.15.132:0/1015118074 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.927 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd64985e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd63c0452c0 0x7fd63c0dfe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51378/0 (socket says 172.21.15.132:51378) 2024-04-25T12:50:43.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fa20b80b640 1 -- 172.21.15.132:0/2364350719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0005140 msgr2=0x7fa1f00037a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55aa6a0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55a40cb330 0x7f55a40cd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.928 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fa20b80b640 1 --2- 172.21.15.132:0/2364350719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1f0005140 0x7fa1f00037a0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa20000e190 tx=0x7fa1f0005830 comp rx=0 tx=0).stop 2024-04-25T12:50:43.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55aa6a0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a40ca3b0 0x7f55a40cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd45ecbe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4500e3770 0x7fd45017cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.929 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fa209da8640 1 -- 172.21.15.132:0/2364350719 reap_dead start 2024-04-25T12:50:43.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd45dcbc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd45004ba30 0x7fd4500e2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd45dcbc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd45004ba30 0x7fd4500e2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:54976/0 (socket says 172.21.15.132:54976) 2024-04-25T12:50:43.930 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fc3f1c59640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc3ec157cb0 0x7fc3ec0c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fc3eb7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc3ec151170 0x7fc3ec0c7550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36918/0 (socket says 172.21.15.132:36918) 2024-04-25T12:50:43.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55a40c61a0 0x7f55a40c9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.931 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55a3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55a40c61a0 0x7f55a40c9e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51382/0 (socket says 172.21.15.132:51382) 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55a3fff640 1 -- 172.21.15.132:0/1644252380 learned_addr learned my addr 172.21.15.132:0/1644252380 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55aa6a0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f55a415eba0 con 0x7f55a40c61a0 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55aa6a0640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f55a415e8c0 con 0x7f55a40ca3b0 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7f55aa6a0640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f55a415ee80 con 0x7f55a40cb330 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fd45dcbc640 1 -- 172.21.15.132:0/4041786831 learned_addr learned my addr 172.21.15.132:0/4041786831 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.894+0000 7fc3eb7fe640 1 -- 172.21.15.132:0/535986232 learned_addr learned my addr 172.21.15.132:0/535986232 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:43.932 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45d4bb640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4500e3770 0x7fd45017cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fa20b80b640 1 -- 172.21.15.132:0/2364350719 shutdown_connections 2024-04-25T12:50:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500da040 0x7fd45004ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.933 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a40ca3b0 0x7f55a40cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd450045950 con 0x7fd4500da040 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd450045670 con 0x7fd4500e3770 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64985e640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd63c0dd440 msgr2=0x7fd63c182cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64985e640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd63c0dd440 0x7fd63c182cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64985e640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0e6760 msgr2=0x7fd63c0e3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64985e640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0e6760 0x7fd63c0e3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64985e640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63c04fc20 con 0x7fd63c0452c0 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd63c0e6760 0x7fd63c0e3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:43.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64905d640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd63c0dd440 0x7fd63c182cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fa20b80b640 1 -- 172.21.15.132:0/2364350719 >> 172.21.15.132:0/2364350719 conn(0x7fa2040730a0 msgr2=0x7fa20406cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f8af2cfb640 1 -- 172.21.15.132:0/724750838 shutdown_connections 2024-04-25T12:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/724750838 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec0c7830 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/724750838 >> v2:172.21.15.157:3300/0 conn(0x7f8aec0c8f80 0x7f8aec0ccad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f8af2cfb640 1 -- 172.21.15.132:0/724750838 >> 172.21.15.132:0/724750838 conn(0x7f8aec06cba0 msgr2=0x7f8aec06cf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd450045c30 con 0x7fd45004ba30 2024-04-25T12:50:43.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fa20b80b640 1 -- 172.21.15.132:0/2364350719 shutdown_connections 2024-04-25T12:50:43.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fa20b80b640 1 -- 172.21.15.132:0/2364350719 wait complete. 2024-04-25T12:50:43.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45e4bd640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500da040 0x7fd45004ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd64985e640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd63c0452c0 0x7fd63c0dfe30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd64000c410 tx=0x7fd64000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a37fe640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55a40cb330 0x7f55a40cd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 -- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55a40cb330 msgr2=0x7f55a40cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45dcbc640 1 -- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4500e3770 msgr2=0x7fd45017cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec15a7a0 con 0x7fc3ec151170 2024-04-25T12:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec15aa80 con 0x7fc3ec0c9310 2024-04-25T12:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc3ec0c9760 con 0x7fc3ec157cb0 2024-04-25T12:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fc3eaffd640 1 --2- 172.21.15.132:0/535986232 >> v2:172.21.15.157:3300/0 conn(0x7fc3ec157cb0 0x7fc3ec0c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45dcbc640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4500e3770 0x7fd45017cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45dcbc640 1 -- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500da040 msgr2=0x7fd45004ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7fd45dcbc640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4500da040 0x7fd45004ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55a40cb330 0x7f55a40cd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 -- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55a40c61a0 msgr2=0x7f55a40c9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55a40c61a0 0x7f55a40c9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55a41ff110 con 0x7f55a40ca3b0 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a37fe640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f55a40cb330 0x7f55a40cd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f55a8c3d640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a40ca3b0 0x7f55a40cd8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f559400b3c0 tx=0x7f559400b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940118f0 con 0x7f55a40ca3b0 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5594016070 con 0x7f55a40ca3b0 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd45dcbc640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4500e2e50 con 0x7fd45004ba30 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd45d4bb640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd4500e3770 0x7fd45017cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd45dcbc640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd45004ba30 0x7fd4500e2910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd4540046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 720604310 0 0) 0x7fc3ec15a7a0 con 0x7fc3ec151170 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d4003520 con 0x7fc3ec151170 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3681436970 0 0) 0x7fc3ec15aa80 con 0x7fc3ec0c9310 2024-04-25T12:50:43.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d40048e0 con 0x7fc3ec0c9310 2024-04-25T12:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3eaffd640 1 -- 172.21.15.132:0/535986232 >> v1:172.21.15.157:6789/0 conn(0x7fc3ec0c9310 legacy=0x7fc3ec071320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3eaffd640 1 -- 172.21.15.132:0/535986232 >> v1:172.21.15.132:6789/0 conn(0x7fc3ec151170 legacy=0x7fc3ec0c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fc3eaffd640 1 -- 172.21.15.132:0/535986232 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec15ad60 con 0x7fc3ec157cb0 2024-04-25T12:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f8af2cfb640 1 -- 172.21.15.132:0/724750838 shutdown_connections 2024-04-25T12:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640017070 con 0x7fd63c0452c0 2024-04-25T12:50:43.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63c04fee0 con 0x7fd63c0452c0 2024-04-25T12:50:43.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.895+0000 7f1ffdb07640 1 -- 172.21.15.132:0/718500229 wait complete. 2024-04-25T12:50:43.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f1ffdb07640 1 Processor -- start 2024-04-25T12:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454041020 con 0x7fd45004ba30 2024-04-25T12:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd454003c40 con 0x7fd45004ba30 2024-04-25T12:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd454041020 con 0x7fd45004ba30 2024-04-25T12:50:43.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd45017d100 con 0x7fd45004ba30 2024-04-25T12:50:43.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd640005230 con 0x7fd63c0452c0 2024-04-25T12:50:43.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd63c0de830 con 0x7fd63c0452c0 2024-04-25T12:50:43.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400045e0 con 0x7fd63c0452c0 2024-04-25T12:50:43.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f1ffdb07640 1 -- start start 2024-04-25T12:50:43.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594011cf0 con 0x7f55a40ca3b0 2024-04-25T12:50:43.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7f55aa6a0640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55a41fee30 con 0x7f55a40ca3b0 2024-04-25T12:50:43.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7f55aa6a0640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55a4157490 con 0x7f55a40ca3b0 2024-04-25T12:50:43.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd450178c90 con 0x7fd45004ba30 2024-04-25T12:50:43.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f688d994640 1 Processor -- start 2024-04-25T12:50:43.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f688d994640 1 -- start start 2024-04-25T12:50:43.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7fa20b80b640 1 Processor -- start 2024-04-25T12:50:43.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7fa20b80b640 1 -- start start 2024-04-25T12:50:43.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.896+0000 7f8af2cfb640 1 -- 172.21.15.132:0/724750838 wait complete. 2024-04-25T12:50:43.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7f8af2cfb640 1 Processor -- start 2024-04-25T12:50:43.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.897+0000 7f8af2cfb640 1 -- start start 2024-04-25T12:50:43.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd450005360 con 0x7fd45004ba30 2024-04-25T12:50:43.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd63c005380 con 0x7fd63c0452c0 2024-04-25T12:50:43.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ffdb07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ff80c61a0 0x7f1ff8150c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ffdb07640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80cb330 0x7f1ff81e4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ffdb07640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff8155500 0x7f1ff814e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ffdb07640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff81558e0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ffdb07640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1ff815ee80 con 0x7f1ff80cb330 2024-04-25T12:50:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ffdb07640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1ff815f680 con 0x7f1ff8155500 2024-04-25T12:50:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ff77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ff80c61a0 0x7f1ff8150c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ff77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ff80c61a0 0x7f1ff8150c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51412/0 (socket says 172.21.15.132:51412) 2024-04-25T12:50:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f1ff77fe640 1 -- 172.21.15.132:0/1640536195 learned_addr learned my addr 172.21.15.132:0/1640536195 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fa20b80b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa20414d3d0 0x7fa204158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fa20b80b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20414d7b0 0x7fa2041f0910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f55aa6a0640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f55a40ce260 con 0x7f55a40ca3b0 2024-04-25T12:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fa20b80b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20414c300 0x7fa20414c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fa20b80b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa20415e690 con 0x7fa20414d3d0 2024-04-25T12:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fa20b80b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa20415bf50 con 0x7fa20414c300 2024-04-25T12:50:43.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7fa20b80b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa20415b0a0 con 0x7fa20414d7b0 2024-04-25T12:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.898+0000 7f688d994640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888154030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f688d994640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6888159880 0x7f68881ec570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f688d994640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 0x7f68881558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f688d994640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6888163390 con 0x7f6888159880 2024-04-25T12:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f688d994640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f68881630b0 con 0x7f6888160c30 2024-04-25T12:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f688d994640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6888163670 con 0x7f68880c75c0 2024-04-25T12:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888154030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888154030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55006/0 (socket says 172.21.15.132:55006) 2024-04-25T12:50:43.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 -- 172.21.15.132:0/1863448303 learned_addr learned my addr 172.21.15.132:0/1863448303 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fa208da6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20414d7b0 0x7fa2041f0910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fa208da6640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20414d7b0 0x7fa2041f0910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55010/0 (socket says 172.21.15.132:55010) 2024-04-25T12:50:43.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fa208da6640 1 -- 172.21.15.132:0/1026440576 learned_addr learned my addr 172.21.15.132:0/1026440576 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af2cfb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec1f5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af2cfb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aec0c8f80 0x7f8aec1f8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fc3eaffd640 1 --2- 172.21.15.132:0/535986232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec157cb0 0x7fc3ec0c8dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000dbc0 tx=0x7fc3e002e4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa91d23e0cc05314 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af1cf9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec1f5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fa2095a7640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa20414d3d0 0x7fa204158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af1cf9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec1f5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55022/0 (socket says 172.21.15.132:55022) 2024-04-25T12:50:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af1cf9640 1 -- 172.21.15.132:0/1412319325 learned_addr learned my addr 172.21.15.132:0/1412319325 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8aec159660 0x7f8aec15a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd64001a070 con 0x7fd63c0452c0 2024-04-25T12:50:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af14f8640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aec0c8f80 0x7f8aec1f8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e003a070 con 0x7fc3ec157cb0 2024-04-25T12:50:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e000b650 con 0x7fc3ec157cb0 2024-04-25T12:50:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7fc3ea7fc640 1 -- 172.21.15.132:0/535986232 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e000ba20 con 0x7fc3ec157cb0 2024-04-25T12:50:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 -- 172.21.15.132:0/1863448303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 msgr2=0x7f68881558a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:50:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec0720d0 con 0x7f8aec159660 2024-04-25T12:50:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6888160c30 0x7f68881558a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 -- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6888159880 msgr2=0x7f68881ec570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:50:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6888159880 0x7f68881ec570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f6886ffd640 1 -- 172.21.15.132:0/1863448303 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6888154a40 con 0x7f68880c75c0 2024-04-25T12:50:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f1ff77fe640 1 -- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff8155500 msgr2=0x7f1ff814e570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:50:43.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f1ff77fe640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1ff8155500 0x7f1ff814e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f1ff77fe640 1 -- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80cb330 msgr2=0x7f1ff81e4930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:50:43.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f1ff77fe640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1ff80cb330 0x7f1ff81e4930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f1ff77fe640 1 -- 172.21.15.132:0/1640536195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ff81f5160 con 0x7f1ff80c61a0 2024-04-25T12:50:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd454044020 con 0x7fd45004ba30 2024-04-25T12:50:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.899+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f559401b460 con 0x7f55a40ca3b0 2024-04-25T12:50:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd63a7fc640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd62806c9c0 0x7fd62806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f6886ffd640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888154030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f687800c440 tx=0x7f687800c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fa2095a7640 1 -- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20414d7b0 msgr2=0x7fa2041f0910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fa2095a7640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa20414d7b0 0x7fa2041f0910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fa2095a7640 1 -- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20414c300 msgr2=0x7fa20414c780 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:50:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fa2095a7640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa20414c300 0x7fa20414c780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fa2095a7640 1 -- 172.21.15.132:0/1026440576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2040b5890 con 0x7fa20414d3d0 2024-04-25T12:50:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f55a0ff9640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f559006c9c0 0x7f559006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd64008b130 con 0x7fd63c0452c0 2024-04-25T12:50:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6878017070 con 0x7f68880c75c0 2024-04-25T12:50:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68780035f0 con 0x7f68880c75c0 2024-04-25T12:50:43.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68780039e0 con 0x7f68880c75c0 2024-04-25T12:50:43.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6888154e00 con 0x7f68880c75c0 2024-04-25T12:50:43.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd63a7fc640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 0x7fd628078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f559408ba20 con 0x7f55a40ca3b0 2024-04-25T12:50:43.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f688815f3f0 con 0x7f68880c75c0 2024-04-25T12:50:43.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd64905d640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd62806c9c0 0x7fd62806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd44e7fc640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd43c06ccf0 0x7fd43c06f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f55a0ff9640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7f55900760c0 0x7f5590078500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5590078bd0 con 0x7f55900760c0 2024-04-25T12:50:43.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd628078c40 con 0x7fd628076130 2024-04-25T12:50:43.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f1ff77fe640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ff80c61a0 0x7f1ff8150c00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c480 tx=0x7f1fe000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd640092050 con 0x7fd63c0452c0 2024-04-25T12:50:43.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f5594055720 con 0x7f55a40ca3b0 2024-04-25T12:50:43.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec157cb0 msgr2=0x7fc3ec0c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f55a37fe640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7f55900760c0 0x7f5590078500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 0x7fd628078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe0017070 con 0x7f1ff80c61a0 2024-04-25T12:50:43.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fc3f1c59640 1 --2- 172.21.15.132:0/535986232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec157cb0 0x7fc3ec0c8dd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000dbc0 tx=0x7fc3e002e4d0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fe0005ce0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f1ffdb07640 1 -- 172.21.15.132:0/1640536195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ff81f13f0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fd64905d640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd62806c9c0 0x7fd62806ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0077c0 tx=0x7fd6440b6040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 shutdown_connections 2024-04-25T12:50:43.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fc3f1c59640 1 --2- 172.21.15.132:0/535986232 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec157cb0 0x7fc3ec0c8dd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f8af24fa640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8aec159660 0x7f8aec15a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 >> 172.21.15.132:0/535986232 conn(0x7fc3ec067630 msgr2=0x7fc3ec067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:43.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f1ffdb07640 1 -- 172.21.15.132:0/1640536195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ff81f1690 con 0x7f1ff80c61a0 2024-04-25T12:50:43.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8aec071df0 con 0x7f8aec0c8f80 2024-04-25T12:50:43.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8aec159a40 con 0x7f8aec0725f0 2024-04-25T12:50:43.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fe00072d0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 shutdown_connections 2024-04-25T12:50:43.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 0x7fd628078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd454003a40 con 0x7fd45004ba30 2024-04-25T12:50:43.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fd64a05f640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 msgr2=0x7fd628078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-25T12:50:43.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd44e7fc640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fd43c0763f0 0x7fd43c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd454067ea0 con 0x7fd43c0763f0 2024-04-25T12:50:43.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.900+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd4540ac210 con 0x7fd45004ba30 2024-04-25T12:50:43.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fd64a05f640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 msgr2=0x7fd628078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T12:50:43.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6868001030 con 0x7f68880c75c0 2024-04-25T12:50:43.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fc3f1c59640 1 -- 172.21.15.132:0/535986232 wait complete. 2024-04-25T12:50:43.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 0x7fd628078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-25T12:50:43.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 0x7fd628078570 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7fa2095a7640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa20414d3d0 0x7fa204158d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4001df0 tx=0x7fa1f4004d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.901+0000 7f55a37fe640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7f55900760c0 0x7f5590078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7f55a3fff640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f559006c9c0 0x7f559006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 msgr2=0x7fd628078570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T12:50:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd63a7fc640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd628076130 0x7fd628078570 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd63a7fc640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd62807a7f0 0x7fd62807cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== osd.0 v2:172.21.15.132:6808/3942408497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5590078bd0 con 0x7f55900760c0 2024-04-25T12:50:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd62807d1f0 con 0x7fd62807a7f0 2024-04-25T12:50:43.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=26}) -- 0x7fd62807d430 con 0x7fd63c0452c0 2024-04-25T12:50:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f401a070 con 0x7fa20414d3d0 2024-04-25T12:50:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7f55a3fff640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f559006c9c0 0x7f559006ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f559c02a6e0 tx=0x7f559c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd45e4bd640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fd43c0763f0 0x7fd43c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd45e4bd640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fd43c0763f0 0x7fd43c078830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd45d4bb640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd43c06ccf0 0x7fd43c06f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1f4008240 con 0x7fa20414d3d0 2024-04-25T12:50:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1f4008610 con 0x7fa20414d3d0 2024-04-25T12:50:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fc3f1c59640 1 Processor -- start 2024-04-25T12:50:43.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.902+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd62807a7f0 0x7fd62807cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fd45d4bb640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd43c06ccf0 0x7fd43c06f1b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd458051690 tx=0x7fd45806e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f1ffdb07640 1 -- 172.21.15.132:0/1640536195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1fdc001030 con 0x7f1ff80c61a0 2024-04-25T12:50:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f8af1cf9640 1 -- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aec0c8f80 msgr2=0x7f8aec1f8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f8af1cf9640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8aec0c8f80 0x7f8aec1f8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f8af1cf9640 1 -- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8aec159660 msgr2=0x7f8aec15a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f8af1cf9640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8aec159660 0x7f8aec15a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f8af1cf9640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8aec159ea0 con 0x7f8aec0725f0 2024-04-25T12:50:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f8af1cf9640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec1f5b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c480 tx=0x7f8ae800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f687801a070 con 0x7f68880c75c0 2024-04-25T12:50:43.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fd64a05f640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd62807a7f0 0x7fd62807cbe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== osd.1 v2:172.21.15.132:6800/2744549492 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd454067ea0 con 0x7fd43c0763f0 2024-04-25T12:50:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fc3f1c59640 1 -- start start 2024-04-25T12:50:43.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa20415a810 con 0x7fa20414d3d0 2024-04-25T12:50:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa20415ad90 con 0x7fa20414d3d0 2024-04-25T12:50:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.903+0000 7f686ffff640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f687406c9c0 0x7f687406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f687808b1e0 con 0x7f68880c75c0 2024-04-25T12:50:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f68867fc640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f687406c9c0 0x7f687406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f686ffff640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f6874076140 0x7f6874078580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 --> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6878016ec0 con 0x7f6874076140 2024-04-25T12:50:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f6878092050 con 0x7f68880c75c0 2024-04-25T12:50:43.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f68877fe640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f6874076140 0x7f6874078580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3f1c59640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0c9310 0x7fc3ec152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3f1c59640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3ec151170 0x7fc3ec1543e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3f1c59640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3ec157cb0 0x7fc3ec1f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3f1c59640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec0c7c60 con 0x7fc3ec151170 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3f1c59640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc3ec15b320 con 0x7fc3ec0c9310 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3f1c59640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc3ec0c7de0 con 0x7fc3ec157cb0 2024-04-25T12:50:43.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3eb7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0c9310 0x7fc3ec152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80052d0 con 0x7f8aec0725f0 2024-04-25T12:50:43.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ae8005470 con 0x7f8aec0725f0 2024-04-25T12:50:43.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f68877fe640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f6874076140 0x7f6874078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3eb7fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0c9310 0x7fc3ec152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39684/0 (socket says 172.21.15.132:39684) 2024-04-25T12:50:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3eb7fe640 1 -- 172.21.15.132:0/3746146105 learned_addr learned my addr 172.21.15.132:0/3746146105 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.904+0000 7fc3ebfff640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3ec157cb0 0x7fc3ec1f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7fc3ebfff640 1 -- 172.21.15.132:0/3746146105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0c9310 msgr2=0x7fc3ec152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7fc3ebfff640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc3ec0c9310 0x7fc3ec152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:43.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7fc3ebfff640 1 -- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3ec151170 msgr2=0x7fc3ec1543e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:50:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8aec15a180 con 0x7f8aec0725f0 2024-04-25T12:50:43.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== osd.4 v2:172.21.15.157:6824/361858762 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd62807d1f0 con 0x7fd62807a7f0 2024-04-25T12:50:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fe001a070 con 0x7f1ff80c61a0 2024-04-25T12:50:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f1ff4ff9640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1fd806c9c0 0x7f1fd806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1fe008bbc0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7fc3eaffd640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3ec151170 0x7fc3ec1543e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f1ff4ff9640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f1fd8076130 0x7f1fd8078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 --> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fe0010e50 con 0x7f1fd8076130 2024-04-25T12:50:43.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1fe008bfb0 con 0x7f1ff80c61a0 2024-04-25T12:50:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2040741e0 con 0x7fa20414d3d0 2024-04-25T12:50:43.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f1feffff640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1fd806c9c0 0x7f1fd806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f68867fc640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f687406c9c0 0x7f687406ee80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f68880679c0 tx=0x7f687c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:43.999 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.905+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ae80052d0 con 0x7f8aec0725f0 2024-04-25T12:50:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== osd.2 v2:172.21.15.132:6816/1070089983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6878016ec0 con 0x7f6874076140 2024-04-25T12:50:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7fc3ebfff640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3ec151170 0x7fc3ec1543e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7fc3ebfff640 1 -- 172.21.15.132:0/3746146105 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec1f5f00 con 0x7fc3ec157cb0 2024-04-25T12:50:44.000 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7fc3eaffd640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3ec151170 0x7fc3ec1543e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:44.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8aec1f5380 con 0x7f8aec0725f0 2024-04-25T12:50:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f1ff7fff640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f1fd8076130 0x7f1fd8078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.906+0000 7f1feffff640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1fd806c9c0 0x7f1fd806ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8073600 tx=0x7f1fe8009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7fc3ebfff640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3ec157cb0 0x7fc3ec1f8590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c7b0 tx=0x7fc3e400cc70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e4003b70 con 0x7fc3ec157cb0 2024-04-25T12:50:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3e4003d30 con 0x7fc3ec157cb0 2024-04-25T12:50:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e40052b0 con 0x7fc3ec157cb0 2024-04-25T12:50:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec0c2c60 con 0x7fc3ec157cb0 2024-04-25T12:50:44.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1f5420 con 0x7fc3ec157cb0 2024-04-25T12:50:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.907+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8aec159c50 con 0x7f8aec0725f0 2024-04-25T12:50:44.004 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.908+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa1f401d070 con 0x7fa20414d3d0 2024-04-25T12:50:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.908+0000 7fa1f9ffb640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1e806c920 0x7fa1e806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.005 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.908+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8ae8012630 con 0x7f8aec0725f0 2024-04-25T12:50:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.908+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc3e4005450 con 0x7fc3ec157cb0 2024-04-25T12:50:44.006 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc3ec0c2f40 con 0x7fc3ec157cb0 2024-04-25T12:50:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa1f408b620 con 0x7fa20414d3d0 2024-04-25T12:50:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fa1f9ffb640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7fa1e80760a0 0x7fa1e80784e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 --> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1e8078bb0 con 0x7fa1e80760a0 2024-04-25T12:50:44.007 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fa1f4092050 con 0x7fa20414d3d0 2024-04-25T12:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f8ade7fc640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8ad006cb20 0x7f8ad006efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f1ff7fff640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f1fd8076130 0x7f1fd8078570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8ae808b6c0 con 0x7f8aec0725f0 2024-04-25T12:50:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f8ade7fc640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7f8ad0076210 0x7f8ad0078650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ae800ee50 con 0x7f8ad0076210 2024-04-25T12:50:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fc3d3fff640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc3d806c8f0 0x7fc3d806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc3e408bca0 con 0x7fc3ec157cb0 2024-04-25T12:50:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fc3d3fff640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7fc3d8075fe0 0x7fc3d8078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 --> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3d8078af0 con 0x7fc3d8075fe0 2024-04-25T12:50:44.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fc3e408e2c0 con 0x7fc3ec157cb0 2024-04-25T12:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8ae8092050 con 0x7f8aec0725f0 2024-04-25T12:50:44.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7f8af14f8640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8ad006cb20 0x7f8ad006efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fa208da6640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1e806c920 0x7fa1e806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7f8af24fa640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7f8ad0076210 0x7f8ad0078650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.909+0000 7fa209da8640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7fa1e80760a0 0x7fa1e80784e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7fc3eaffd640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7fc3d8075fe0 0x7fc3d8078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7fa209da8640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7fa1e80760a0 0x7fa1e80784e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.014 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7fc3eb7fe640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc3d806c8f0 0x7fc3d806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== osd.7 v2:172.21.15.157:6808/3050581758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1fe0010e50 con 0x7f1fd8076130 2024-04-25T12:50:44.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7fa208da6640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1e806c920 0x7fa1e806ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa20000e190 tx=0x7fa20002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7f8af24fa640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7f8ad0076210 0x7f8ad0078650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7f8af14f8640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8ad006cb20 0x7f8ad006efe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8aec149ee0 tx=0x7f8ae4009830 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.910+0000 7fc3eaffd640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7fc3d8075fe0 0x7fc3d8078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.911+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== osd.5 v2:172.21.15.157:6800/1305108505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1e8078bb0 con 0x7fa1e80760a0 2024-04-25T12:50:44.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.911+0000 7fc3eb7fe640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc3d806c8f0 0x7fc3d806edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc007fd0 tx=0x7fc3dc007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.911+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== osd.6 v2:172.21.15.157:6816/898532685 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8ae800ee50 con 0x7f8ad0076210 2024-04-25T12:50:44.018 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.911+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== osd.3 v2:172.21.15.132:6824/4017369703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc3d8078af0 con 0x7fc3d8075fe0 2024-04-25T12:50:44.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.937+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 --> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd45004b810 con 0x7fd43c0763f0 2024-04-25T12:50:44.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.937+0000 7f55aa6a0640 1 -- 172.21.15.132:0/1644252380 --> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f55a40741e0 con 0x7f55900760c0 2024-04-25T12:50:44.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.937+0000 7fd44e7fc640 1 -- 172.21.15.132:0/4041786831 <== osd.1 v2:172.21.15.132:6800/2744549492 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd45004b810 con 0x7fd43c0763f0 2024-04-25T12:50:44.020 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fd43c0763f0 msgr2=0x7fd43c078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fd43c0763f0 0x7fd43c078830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7f55a0ff9640 1 -- 172.21.15.132:0/1644252380 <== osd.0 v2:172.21.15.132:6808/3942408497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f55a40741e0 con 0x7f55900760c0 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd43c06ccf0 msgr2=0x7fd43c06f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd43c06ccf0 0x7fd43c06f1b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd458051690 tx=0x7fd45806e040 comp rx=0 tx=0).stop 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd45004ba30 msgr2=0x7fd4500e2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 --2- 172.21.15.132:0/4041786831 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd45004ba30 0x7fd4500e2910 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd454000c00 tx=0x7fd4540046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45e4bd640 1 -- 172.21.15.132:0/4041786831 reap_dead start 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 shutdown_connections 2024-04-25T12:50:44.022 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.938+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 >> 172.21.15.132:0/4041786831 conn(0x7fd450050150 msgr2=0x7fd450032c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7f55900760c0 msgr2=0x7f5590078500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7f55900760c0 0x7f5590078500 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.023 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 --> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd63c032c00 con 0x7fd62807a7f0 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f559006c9c0 msgr2=0x7f559006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f559006c9c0 0x7f559006ee80 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f559c02a6e0 tx=0x7f559c02f000 comp rx=0 tx=0).stop 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a40ca3b0 msgr2=0x7f55a40cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 --2- 172.21.15.132:0/1644252380 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f55a40ca3b0 0x7f55a40cd8b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f559400b3c0 tx=0x7f559400b880 comp rx=0 tx=0).stop 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 shutdown_connections 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7fd45ecbe640 1 -- 172.21.15.132:0/4041786831 wait complete. 2024-04-25T12:50:44.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f55a8c3d640 1 -- 172.21.15.132:0/1644252380 reap_dead start 2024-04-25T12:50:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 --> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6868002dd0 con 0x7f6874076140 2024-04-25T12:50:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 shutdown_connections 2024-04-25T12:50:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 >> 172.21.15.132:0/1644252380 conn(0x7f55a4067c60 msgr2=0x7f55a406cd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7fd63a7fc640 1 -- 172.21.15.132:0/1015118074 <== osd.4 v2:172.21.15.157:6824/361858762 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd63c032c00 con 0x7fd62807a7f0 2024-04-25T12:50:44.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.939+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 shutdown_connections 2024-04-25T12:50:44.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f558a7fc640 1 -- 172.21.15.132:0/1644252380 wait complete. 2024-04-25T12:50:44.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f686ffff640 1 -- 172.21.15.132:0/1863448303 <== osd.2 v2:172.21.15.132:6816/1070089983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6868002dd0 con 0x7f6874076140 2024-04-25T12:50:44.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f6874076140 msgr2=0x7f6874078580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f688d994640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f6874076140 0x7f6874078580 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f687406c9c0 msgr2=0x7f687406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f688d994640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f687406c9c0 0x7f687406ee80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f68880679c0 tx=0x7f687c009190 comp rx=0 tx=0).stop 2024-04-25T12:50:44.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 msgr2=0x7f6888154030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f688d994640 1 --2- 172.21.15.132:0/1863448303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f68880c75c0 0x7f6888154030 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f687800c440 tx=0x7f687800c900 comp rx=0 tx=0).stop 2024-04-25T12:50:44.028 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7f68877fe640 1 -- 172.21.15.132:0/1863448303 reap_dead start 2024-04-25T12:50:44.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.941+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 shutdown_connections 2024-04-25T12:50:44.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.941+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 >> 172.21.15.132:0/1863448303 conn(0x7f6888075db0 msgr2=0x7f68880cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.942+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 shutdown_connections 2024-04-25T12:50:44.029 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd62807a7f0 msgr2=0x7fd62807cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a860640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7fd62807a7f0 0x7fd62807cbe0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd62806c9c0 msgr2=0x7fd62806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a860640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd62806c9c0 0x7fd62806ee80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd63c0077c0 tx=0x7fd6440b6040 comp rx=0 tx=0).stop 2024-04-25T12:50:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd63c0452c0 msgr2=0x7fd63c0dfe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a860640 1 --2- 172.21.15.132:0/1015118074 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd63c0452c0 0x7fd63c0dfe30 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd64000c410 tx=0x7fd64000c8d0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.940+0000 7fd64a05f640 1 -- 172.21.15.132:0/1015118074 reap_dead start 2024-04-25T12:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.941+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 shutdown_connections 2024-04-25T12:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.941+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 >> 172.21.15.132:0/1015118074 conn(0x7fd63c050170 msgr2=0x7fd63c0d8740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.942+0000 7f688d994640 1 -- 172.21.15.132:0/1863448303 wait complete. 2024-04-25T12:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.942+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 shutdown_connections 2024-04-25T12:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.942+0000 7fd64a860640 1 -- 172.21.15.132:0/1015118074 wait complete. 2024-04-25T12:50:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.944+0000 7f1ffdb07640 1 -- 172.21.15.132:0/1640536195 --> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1fdc002dd0 con 0x7f1fd8076130 2024-04-25T12:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.945+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 --> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc3ec0c2f40 con 0x7fc3d8075fe0 2024-04-25T12:50:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.945+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 --> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8aec0741e0 con 0x7f8ad0076210 2024-04-25T12:50:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.945+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 --> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2040cc0e0 con 0x7fa1e80760a0 2024-04-25T12:50:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.945+0000 7fc3d3fff640 1 -- 172.21.15.132:0/3746146105 <== osd.3 v2:172.21.15.132:6824/4017369703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc3ec0c2f40 con 0x7fc3d8075fe0 2024-04-25T12:50:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.945+0000 7f1ff4ff9640 1 -- 172.21.15.132:0/1640536195 <== osd.7 v2:172.21.15.157:6808/3050581758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1fdc002dd0 con 0x7f1fd8076130 2024-04-25T12:50:44.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.945+0000 7f8ade7fc640 1 -- 172.21.15.132:0/1412319325 <== osd.6 v2:172.21.15.157:6816/898532685 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8aec0741e0 con 0x7f8ad0076210 2024-04-25T12:50:44.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fa1f9ffb640 1 -- 172.21.15.132:0/1026440576 <== osd.5 v2:172.21.15.157:6800/1305108505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fa2040cc0e0 con 0x7fa1e80760a0 2024-04-25T12:50:44.037 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7fc3d8075fe0 msgr2=0x7fc3d8078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fc3f1c59640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7fc3d8075fe0 0x7fc3d8078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7fa1e80760a0 msgr2=0x7fa1e80784e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fa20b80b640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7fa1e80760a0 0x7fa1e80784e0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1e806c920 msgr2=0x7fa1e806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.946+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc3d806c8f0 msgr2=0x7fc3d806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f1fd8076130 msgr2=0x7f1fd8078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f1fd8076130 0x7f1fd8078570 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc3d806c8f0 0x7fc3d806edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc3dc007fd0 tx=0x7fc3dc007dc0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa1e806c920 0x7fa1e806ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fa20000e190 tx=0x7fa20002f000 comp rx=0 tx=0).stop 2024-04-25T12:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa20414d3d0 msgr2=0x7fa204158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 --2- 172.21.15.132:0/1026440576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa20414d3d0 0x7fa204158d20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa1f4001df0 tx=0x7fa1f4004d80 comp rx=0 tx=0).stop 2024-04-25T12:50:44.042 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa209da8640 1 -- 172.21.15.132:0/1026440576 reap_dead start 2024-04-25T12:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3ec157cb0 msgr2=0x7fc3ec1f8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 --2- 172.21.15.132:0/3746146105 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc3ec157cb0 0x7fc3ec1f8590 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc3e400c7b0 tx=0x7fc3e400cc70 comp rx=0 tx=0).stop 2024-04-25T12:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 shutdown_connections 2024-04-25T12:50:44.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 >> 172.21.15.132:0/1026440576 conn(0x7fa2040730a0 msgr2=0x7fa2040c5f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1fd806c9c0 msgr2=0x7f1fd806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1fd806c9c0 0x7f1fd806ee80 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8073600 tx=0x7f1fe8009190 comp rx=0 tx=0).stop 2024-04-25T12:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ff80c61a0 msgr2=0x7f1ff8150c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 --2- 172.21.15.132:0/1640536195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ff80c61a0 0x7f1ff8150c00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1fe000c480 tx=0x7f1fe000c940 comp rx=0 tx=0).stop 2024-04-25T12:50:44.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1ff7fff640 1 -- 172.21.15.132:0/1640536195 reap_dead start 2024-04-25T12:50:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3ebfff640 1 -- 172.21.15.132:0/3746146105 reap_dead start 2024-04-25T12:50:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 shutdown_connections 2024-04-25T12:50:44.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 >> 172.21.15.132:0/3746146105 conn(0x7fc3ec067630 msgr2=0x7fc3ec1590f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 shutdown_connections 2024-04-25T12:50:44.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fa20b80b640 1 -- 172.21.15.132:0/1026440576 wait complete. 2024-04-25T12:50:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 shutdown_connections 2024-04-25T12:50:44.047 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 >> 172.21.15.132:0/1640536195 conn(0x7f1ff8067c60 msgr2=0x7f1ff80c6580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 shutdown_connections 2024-04-25T12:50:44.048 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7fc3f1c59640 1 -- 172.21.15.132:0/3746146105 wait complete. 2024-04-25T12:50:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7f8ad0076210 msgr2=0x7f8ad0078650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7f8ad0076210 0x7f8ad0078650 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8ad006cb20 msgr2=0x7f8ad006efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8ad006cb20 0x7f8ad006efe0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f8aec149ee0 tx=0x7f8ae4009830 comp rx=0 tx=0).stop 2024-04-25T12:50:44.049 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 msgr2=0x7f8aec1f5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 --2- 172.21.15.132:0/1412319325 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8aec0725f0 0x7f8aec1f5b80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8ae800c480 tx=0x7f8ae800c940 comp rx=0 tx=0).stop 2024-04-25T12:50:44.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af24fa640 1 -- 172.21.15.132:0/1412319325 reap_dead start 2024-04-25T12:50:44.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.947+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 shutdown_connections 2024-04-25T12:50:44.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 shutdown_connections 2024-04-25T12:50:44.050 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 >> 172.21.15.132:0/1412319325 conn(0x7f8aec06cba0 msgr2=0x7f8aec154820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f1fedffb640 1 -- 172.21.15.132:0/1640536195 wait complete. 2024-04-25T12:50:44.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 shutdown_connections 2024-04-25T12:50:44.051 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:43.948+0000 7f8af2cfb640 1 -- 172.21.15.132:0/1412319325 wait complete. 2024-04-25T12:50:44.052 INFO:teuthology.orchestra.run.smithi132.stdout:60129542155 2024-04-25T12:50:44.052 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T12:50:44.053 INFO:teuthology.orchestra.run.smithi132.stdout:60129542156 2024-04-25T12:50:44.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T12:50:44.054 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2024-04-25T12:50:44.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T12:50:44.055 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2024-04-25T12:50:44.056 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T12:50:44.057 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:44.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T12:50:44.057 INFO:teuthology.orchestra.run.smithi132.stdout:55834574860 2024-04-25T12:50:44.058 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T12:50:44.058 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:44.059 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T12:50:44.060 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:44.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T12:50:44.259 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.261+0000 7f70155f9640 1 Processor -- start 2024-04-25T12:50:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.261+0000 7f70155f9640 1 -- start start 2024-04-25T12:50:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.261+0000 7f95b1607640 1 Processor -- start 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f70155f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c53d0 0x7f70100cc850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f70155f9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f70100c75c0 0x7f70100c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f70155f9640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7010167ee0 con 0x7f70100cc470 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f70155f9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f70101681c0 con 0x7f70100c75c0 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f70155f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f70101684a0 con 0x7f70100c53d0 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f700e7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c53d0 0x7f70100cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f700f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f70100c75c0 0x7f70100c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f700f7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f70100c75c0 0x7f70100c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39700/0 (socket says 172.21.15.132:39700) 2024-04-25T12:50:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f700f7fe640 1 -- 172.21.15.132:0/2285660249 learned_addr learned my addr 172.21.15.132:0/2285660249 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.262+0000 7f95b1607640 1 -- start start 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95b1607640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f95ac151200 0x7f95ac0c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95b1607640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95ac15b260 0x7f95ac156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95b1607640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac157aa0 con 0x7f95ac157530 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95b1607640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f95ac0c4500 con 0x7f95ac15b260 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95b1607640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f95ac157d80 con 0x7f95ac151200 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f700f7fe640 1 -- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c53d0 msgr2=0x7f70100cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f700f7fe640 1 --2- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c53d0 0x7f70100cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f700f7fe640 1 -- 172.21.15.132:0/2285660249 >> v1:172.21.15.157:6789/0 conn(0x7f70100cc470 legacy=0x7f70100c4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f700f7fe640 1 -- 172.21.15.132:0/2285660249 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7010168780 con 0x7f70100c75c0 2024-04-25T12:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95aa7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95ac15b260 0x7f95ac156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95aa7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95ac15b260 0x7f95ac156ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51452/0 (socket says 172.21.15.132:51452) 2024-04-25T12:50:44.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95aa7fc640 1 -- 172.21.15.132:0/1620679287 learned_addr learned my addr 172.21.15.132:0/1620679287 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95aaffd640 1 --2- 172.21.15.132:0/1620679287 >> v2:172.21.15.157:3300/0 conn(0x7f95ac151200 0x7f95ac0c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f14bb59e640 1 Processor -- start 2024-04-25T12:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95aa7fc640 1 -- 172.21.15.132:0/1620679287 >> v2:172.21.15.157:3300/0 conn(0x7f95ac151200 msgr2=0x7f95ac0c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7f95aa7fc640 1 --2- 172.21.15.132:0/1620679287 >> v2:172.21.15.157:3300/0 conn(0x7f95ac151200 0x7f95ac0c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.264 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7f95aa7fc640 1 -- 172.21.15.132:0/1620679287 >> v1:172.21.15.157:6789/0 conn(0x7f95ac157530 legacy=0x7f95ac0c7a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7fa54d06e640 1 Processor -- start 2024-04-25T12:50:44.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7fa54d06e640 1 -- start start 2024-04-25T12:50:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7f700f7fe640 1 --2- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c75c0 0x7f70100c79f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f700802c9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a882291150af040 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7f700dffb640 1 -- 172.21.15.132:0/2285660249 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008035020 con 0x7f70100c75c0 2024-04-25T12:50:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7f700dffb640 1 -- 172.21.15.132:0/2285660249 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7008031410 con 0x7f70100c75c0 2024-04-25T12:50:44.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f700dffb640 1 -- 172.21.15.132:0/2285660249 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70080317e0 con 0x7f70100c75c0 2024-04-25T12:50:44.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7f14bb59e640 1 -- start start 2024-04-25T12:50:44.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40dd3c0 0x7f14b4046460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.264+0000 7f95aa7fc640 1 -- 172.21.15.132:0/1620679287 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac15a780 con 0x7f95ac15b260 2024-04-25T12:50:44.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f95aa7fc640 1 --2- 172.21.15.132:0/1620679287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac156ff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95ac068590 tx=0x7f95a402ab00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc4966f13d3b9e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7fe0aad9b640 1 Processor -- start 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.263+0000 7fe0aad9b640 1 -- start start 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0aad9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe09c0f6d80 0x7fe09c0fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0aad9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 0x7fe09c04b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0aad9b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe09c0066e0 con 0x7fe09c04b600 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0aad9b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe09c0f7160 con 0x7fe09c0f6d80 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0aad9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c0075d0 con 0x7fe09c005ec0 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f95a9ffb640 1 -- 172.21.15.132:0/1620679287 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4032070 con 0x7f95ac15b260 2024-04-25T12:50:44.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f95a9ffb640 1 -- 172.21.15.132:0/1620679287 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95a402c610 con 0x7f95ac15b260 2024-04-25T12:50:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f95a9ffb640 1 -- 172.21.15.132:0/1620679287 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a402c9e0 con 0x7f95ac15b260 2024-04-25T12:50:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fa54d06e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa54815bb50 0x7fa5480d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fa54d06e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5480d14b0 con 0x7fa548155530 2024-04-25T12:50:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f14ee828640 1 Processor -- start 2024-04-25T12:50:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0a3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 0x7fe09c04b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0a3fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 0x7fe09c04b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55052/0 (socket says 172.21.15.132:55052) 2024-04-25T12:50:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0a3fff640 1 -- 172.21.15.132:0/2911369135 learned_addr learned my addr 172.21.15.132:0/2911369135 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fa54d06e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5480c7e70 con 0x7fa5480d0d30 2024-04-25T12:50:44.270 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fa54d06e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa5480c8aa0 con 0x7fa54815bb50 2024-04-25T12:50:44.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fa54c86d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa5480d0d30 0x7fa5480c8f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60788/0 (socket says 172.21.15.132:60788) 2024-04-25T12:50:44.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fa54c86d640 1 -- 172.21.15.132:0/1778740511 learned_addr learned my addr 172.21.15.132:0/1778740511 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:44.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 -- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c75c0 msgr2=0x7f70100c79f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.272 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14ee828640 1 -- start start 2024-04-25T12:50:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fe0a3fff640 1 -- 172.21.15.132:0/2911369135 >> v2:172.21.15.132:3300/0 conn(0x7fe09c0f6d80 msgr2=0x7fe09c0fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7fe0a8b37640 1 --2- 172.21.15.132:0/2911369135 >> v2:172.21.15.132:3300/0 conn(0x7fe09c0f6d80 0x7fe09c0fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fe0a3fff640 1 --2- 172.21.15.132:0/2911369135 >> v2:172.21.15.132:3300/0 conn(0x7fe09c0f6d80 0x7fe09c0fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fe0a3fff640 1 -- 172.21.15.132:0/2911369135 >> v1:172.21.15.132:6789/0 conn(0x7fe09c04b600 legacy=0x7fe09c045250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fe0a3fff640 1 -- 172.21.15.132:0/2911369135 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c0069c0 con 0x7fe09c005ec0 2024-04-25T12:50:44.273 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104594290 0 0) 0x7fa5480c7e70 con 0x7fa5480d0d30 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f14bb59e640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14b404ba60 0x7f14b404be80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f14bb59e640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14b40dd7a0 con 0x7f14b40e3090 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f14bb59e640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f14b4045450 con 0x7f14b404ba60 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.265+0000 7f14bb59e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f14b4045fd0 con 0x7f14b40dd3c0 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14b404ba60 0x7f14b404be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14b404ba60 0x7f14b404be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39720/0 (socket says 172.21.15.132:39720) 2024-04-25T12:50:44.274 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 -- 172.21.15.132:0/3244732439 learned_addr learned my addr 172.21.15.132:0/3244732439 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 --2- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c75c0 0x7f70100c79f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7008009e50 tx=0x7f700802c9c0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14ba59c640 1 --2- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40dd3c0 0x7f14b4046460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f95b1607640 1 -- 172.21.15.132:0/1620679287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 msgr2=0x7f95ac156ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f95b1607640 1 --2- 172.21.15.132:0/1620679287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac156ff0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f95ac068590 tx=0x7f95a402ab00 comp rx=0 tx=0).stop 2024-04-25T12:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f95b1607640 1 -- 172.21.15.132:0/1620679287 shutdown_connections 2024-04-25T12:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f95b1607640 1 --2- 172.21.15.132:0/1620679287 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac156ff0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f95b1607640 1 --2- 172.21.15.132:0/1620679287 >> v2:172.21.15.157:3300/0 conn(0x7f95ac151200 0x7f95ac0c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f95b1607640 1 -- 172.21.15.132:0/1620679287 >> 172.21.15.132:0/1620679287 conn(0x7f95ac067630 msgr2=0x7f95ac067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7fe0a8b37640 1 --2- 172.21.15.132:0/2911369135 >> v2:172.21.15.132:3300/0 conn(0x7fe09c0f6d80 0x7fe09c0fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 -- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40dd3c0 msgr2=0x7f14b4046460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 --2- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40dd3c0 0x7f14b4046460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 -- 172.21.15.132:0/3244732439 >> v1:172.21.15.157:6789/0 conn(0x7f14b40e3090 legacy=0x7f14b40e3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f14b9d9b640 1 -- 172.21.15.132:0/3244732439 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b40e3e90 con 0x7f14b404ba60 2024-04-25T12:50:44.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ee828640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f14e004b9b0 0x7f14e004be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ee828640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e00071f0 con 0x7f14e00db210 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ee828640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14e00074d0 con 0x7f14e00dc700 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ee828640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f14e00080e0 con 0x7f14e004b9b0 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 -- 172.21.15.132:0/2285660249 shutdown_connections 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 --2- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c75c0 0x7f70100c79f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 --2- 172.21.15.132:0/2285660249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c53d0 0x7f70100cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 -- 172.21.15.132:0/2285660249 >> 172.21.15.132:0/2285660249 conn(0x7f7010067630 msgr2=0x7f7010067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 -- 172.21.15.132:0/2285660249 shutdown_connections 2024-04-25T12:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7f70155f9640 1 -- 172.21.15.132:0/2285660249 wait complete. 2024-04-25T12:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa530003520 con 0x7fa5480d0d30 2024-04-25T12:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ee027640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f14e00dc700 0x7f14e00dcae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60810/0 (socket says 172.21.15.132:60810) 2024-04-25T12:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ee027640 1 -- 172.21.15.132:0/2810161524 learned_addr learned my addr 172.21.15.132:0/2810161524 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:44.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ed025640 1 --2- 172.21.15.132:0/2810161524 >> v2:172.21.15.157:3300/0 conn(0x7f14e004b9b0 0x7f14e004be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4255845902 0 0) 0x7fa530003520 con 0x7fa5480d0d30 2024-04-25T12:50:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 >> v2:172.21.15.157:3300/0 conn(0x7fa54815bb50 msgr2=0x7fa5480d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fa546ffd640 1 --2- 172.21.15.132:0/1778740511 >> v2:172.21.15.157:3300/0 conn(0x7fa54815bb50 0x7fa5480d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.266+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 >> v1:172.21.15.132:6789/0 conn(0x7fa548155530 legacy=0x7fa5480cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f95b1607640 1 -- 172.21.15.132:0/1620679287 shutdown_connections 2024-04-25T12:50:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f2b3e817640 1 Processor -- start 2024-04-25T12:50:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f8e91b28640 1 Processor -- start 2024-04-25T12:50:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f95b1607640 1 -- 172.21.15.132:0/1620679287 wait complete. 2024-04-25T12:50:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14ec824640 1 -- 172.21.15.132:0/2810161524 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1287605875 0 0) 0x7f14e00074d0 con 0x7f14e00dc700 2024-04-25T12:50:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14ec824640 1 -- 172.21.15.132:0/2810161524 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d4003520 con 0x7f14e00dc700 2024-04-25T12:50:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f14b9d9b640 1 --2- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b404be80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14bc065470 tx=0x7f14bc0a6920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48fc27ca21412fda server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7f8e91b28640 1 -- start start 2024-04-25T12:50:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14b959a640 1 -- 172.21.15.132:0/3244732439 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0a9070 con 0x7f14b404ba60 2024-04-25T12:50:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14b959a640 1 -- 172.21.15.132:0/3244732439 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc0ac6a0 con 0x7f14b404ba60 2024-04-25T12:50:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14b959a640 1 -- 172.21.15.132:0/3244732439 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0acb10 con 0x7f14b404ba60 2024-04-25T12:50:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f70155f9640 1 Processor -- start 2024-04-25T12:50:44.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f70155f9640 1 -- start start 2024-04-25T12:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14ed025640 1 -- 172.21.15.132:0/2810161524 >> v1:172.21.15.157:6789/0 conn(0x7f14e00dc700 legacy=0x7f14e00dcae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14ed025640 1 -- 172.21.15.132:0/2810161524 >> v1:172.21.15.132:6789/0 conn(0x7f14e00db210 legacy=0x7f14e00d5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f14ed025640 1 -- 172.21.15.132:0/2810161524 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e00077b0 con 0x7f14e004b9b0 2024-04-25T12:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.267+0000 7fe0a3fff640 1 --2- 172.21.15.132:0/2911369135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 0x7fe09c04b0c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe098008860 tx=0x7fe09802c620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11bb2b9e676d0b28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7fe0a37fe640 1 -- 172.21.15.132:0/2911369135 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe09803a070 con 0x7fe09c005ec0 2024-04-25T12:50:44.284 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7fe0a37fe640 1 -- 172.21.15.132:0/2911369135 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe098032480 con 0x7fe09c005ec0 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e91b28640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f8e8c0c9920 0x7f8e8c0c9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e91b28640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 0x7f8e8c0c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e91b28640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e8c0c87f0 con 0x7f8e8c0c8c40 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e91b28640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f8e8c0c9630 con 0x7f8e8c0c9920 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e91b28640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c0c7cb0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f14bb59e640 1 -- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 msgr2=0x7f14b404be80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f14bb59e640 1 --2- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b404be80 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f14bc065470 tx=0x7f14bc0a6920 comp rx=0 tx=0).stop 2024-04-25T12:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.268+0000 7f2b3e817640 1 -- start start 2024-04-25T12:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e817640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b380cc2c0 0x7f2b380c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e817640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b380c9d90 0x7f2b38163240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e817640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b380c8280 con 0x7f2b380cc6a0 2024-04-25T12:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e817640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2b380c8560 con 0x7f2b380cc2c0 2024-04-25T12:50:44.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e817640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f2b380c8840 con 0x7f2b380c9d90 2024-04-25T12:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e8bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 0x7f8e8c0c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f14bb59e640 1 -- 172.21.15.132:0/3244732439 shutdown_connections 2024-04-25T12:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f14bb59e640 1 --2- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b404be80 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f14bb59e640 1 --2- 172.21.15.132:0/3244732439 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40dd3c0 0x7f14b4046460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f14bb59e640 1 -- 172.21.15.132:0/3244732439 >> 172.21.15.132:0/3244732439 conn(0x7f14b4050180 msgr2=0x7f14b4050590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e8bfff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 0x7f8e8c0c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55070/0 (socket says 172.21.15.132:55070) 2024-04-25T12:50:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e8bfff640 1 -- 172.21.15.132:0/589448697 learned_addr learned my addr 172.21.15.132:0/589448697 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fe0a37fe640 1 -- 172.21.15.132:0/2911369135 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe098032850 con 0x7fe09c005ec0 2024-04-25T12:50:44.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e016640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b380c9d90 0x7f2b38163240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5480c8150 con 0x7fa5480d0d30 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7fa53c001670 con 0x7fa5480d0d30 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 >> v1:172.21.15.157:6789/0 conn(0x7fa5480d0d30 legacy=0x7fa5480c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5300039b0 0x7fa530003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa530004800 0x7fa530004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa53000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480c8aa0 con 0x7fa530004800 2024-04-25T12:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e016640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f2b380c9d90 0x7f2b38163240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39758/0 (socket says 172.21.15.132:39758) 2024-04-25T12:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3e016640 1 -- 172.21.15.132:0/349227348 learned_addr learned my addr 172.21.15.132:0/349227348 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa53000c1f0 con 0x7fa5300039b0 2024-04-25T12:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa53000c3f0 con 0x7fa5300052c0 2024-04-25T12:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa5477fe640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa530004800 0x7fa530004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f2b3d815640 1 --2- 172.21.15.132:0/349227348 >> v2:172.21.15.132:3300/0 conn(0x7f2b380cc2c0 0x7f2b380c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f95b1607640 1 Processor -- start 2024-04-25T12:50:44.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e90b26640 1 --2- 172.21.15.132:0/589448697 >> v2:172.21.15.157:3300/0 conn(0x7f8e8c0c9920 0x7f8e8c0c9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f95b1607640 1 -- start start 2024-04-25T12:50:44.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7fa547fff640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5300039b0 0x7fa530003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f70155f9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c53d0 0x7f70100c2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f70155f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 0x7f70101f7c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f70155f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70100cc470 0x7f70101604a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 0x7f70101f7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 0x7f70101f7c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55074/0 (socket says 172.21.15.132:55074) 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 -- 172.21.15.132:0/1303971210 learned_addr learned my addr 172.21.15.132:0/1303971210 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f70100c7f30 con 0x7f70100cc470 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7010073e90 con 0x7f70100c53d0 2024-04-25T12:50:44.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f70100c44d0 con 0x7f70100c75c0 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2911369135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 msgr2=0x7fe09c04b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2911369135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 0x7fe09c04b0c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe098008860 tx=0x7fe09802c620 comp rx=0 tx=0).stop 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fa54c86d640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa53000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f2b3e016640 1 -- 172.21.15.132:0/349227348 >> v2:172.21.15.132:3300/0 conn(0x7f2b380cc2c0 msgr2=0x7f2b380c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f2b3e016640 1 --2- 172.21.15.132:0/349227348 >> v2:172.21.15.132:3300/0 conn(0x7f2b380cc2c0 0x7f2b380c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f2b3e016640 1 -- 172.21.15.132:0/349227348 >> v1:172.21.15.132:6789/0 conn(0x7f2b380cc6a0 legacy=0x7f2b380c9680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e8bfff640 1 -- 172.21.15.132:0/589448697 >> v2:172.21.15.157:3300/0 conn(0x7f8e8c0c9920 msgr2=0x7f8e8c0c9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e8bfff640 1 --2- 172.21.15.132:0/589448697 >> v2:172.21.15.157:3300/0 conn(0x7f8e8c0c9920 0x7f8e8c0c9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.269+0000 7f8e8bfff640 1 -- 172.21.15.132:0/589448697 >> v1:172.21.15.132:6789/0 conn(0x7f8e8c0c8c40 legacy=0x7f8e8c162950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f8e8bfff640 1 -- 172.21.15.132:0/589448697 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c0c1f50 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2911369135 shutdown_connections 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2911369135 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c005ec0 0x7fe09c04b0c0 secure :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fe098008860 tx=0x7fe09802c620 comp rx=0 tx=0).stop 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2911369135 >> v2:172.21.15.132:3300/0 conn(0x7fe09c0f6d80 0x7fe09c0fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2911369135 >> 172.21.15.132:0/2911369135 conn(0x7fe09c0501b0 msgr2=0x7fe09c0505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f14ed025640 1 --2- 172.21.15.132:0/2810161524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e004b9b0 0x7f14e004be20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14d80097a0 tx=0x7f14d802a2c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f40eb6569392c4fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f14bb59e640 1 -- 172.21.15.132:0/3244732439 shutdown_connections 2024-04-25T12:50:44.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700f7fe640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70100cc470 0x7f70101604a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.295 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f14bb59e640 1 -- 172.21.15.132:0/3244732439 wait complete. 2024-04-25T12:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f14ec824640 1 -- 172.21.15.132:0/2810161524 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8037070 con 0x7f14e004b9b0 2024-04-25T12:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f14ec824640 1 -- 172.21.15.132:0/2810161524 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14d8032640 con 0x7f14e004b9b0 2024-04-25T12:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f14ec824640 1 -- 172.21.15.132:0/2810161524 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14d8032a10 con 0x7f14e004b9b0 2024-04-25T12:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 -- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c53d0 msgr2=0x7f70100c2930 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:50:44.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c53d0 0x7f70100c2930 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 -- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70100cc470 msgr2=0x7f70101604a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70100cc470 0x7f70101604a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f700e7fc640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70101f7900 con 0x7f70100c75c0 2024-04-25T12:50:44.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2911369135 shutdown_connections 2024-04-25T12:50:44.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2911369135 wait complete. 2024-04-25T12:50:44.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7f2b3e016640 1 -- 172.21.15.132:0/349227348 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b380c8b20 con 0x7f2b380c9d90 2024-04-25T12:50:44.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fa54c86d640 1 -- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5300039b0 msgr2=0x7fa530003df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fa54c86d640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5300039b0 0x7fa530003df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fa54c86d640 1 -- 172.21.15.132:0/1778740511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa530004800 msgr2=0x7fa530004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:44.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fa54c86d640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa530004800 0x7fa530004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.270+0000 7fa54c86d640 1 -- 172.21.15.132:0/1778740511 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5480c8150 con 0x7fa5300052c0 2024-04-25T12:50:44.298 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f700e7fc640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 0x7f70101f7c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f700400e9e0 tx=0x7f700400eea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95b1607640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 0x7f95ac1f0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f2b3e016640 1 --2- 172.21.15.132:0/349227348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380c9d90 0x7f2b38163240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b380c78b0 tx=0x7f2b3002a6f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95cd34efcf6a8294 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95b1607640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95ac157530 0x7f95ac155250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7004017070 con 0x7f70100c75c0 2024-04-25T12:50:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95aaffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 0x7f95ac1f0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7fa54c86d640 1 -- 172.21.15.132:0/1778740511 reap_dead start 2024-04-25T12:50:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f2b3c813640 1 -- 172.21.15.132:0/349227348 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30036070 con 0x7f2b380c9d90 2024-04-25T12:50:44.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f2b3c813640 1 -- 172.21.15.132:0/349227348 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b30031600 con 0x7f2b380c9d90 2024-04-25T12:50:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95aaffd640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 0x7f95ac1f0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39770/0 (socket says 172.21.15.132:39770) 2024-04-25T12:50:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f2b3c813640 1 -- 172.21.15.132:0/349227348 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b30036070 con 0x7f2b380c9d90 2024-04-25T12:50:44.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95aa7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95ac157530 0x7f95ac155250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7fa54c86d640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa53000b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa53c001050 tx=0x7fa530005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677d9caeb17e4857 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95aa7fc640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95ac157530 0x7f95ac155250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55088/0 (socket says 172.21.15.132:55088) 2024-04-25T12:50:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95b1607640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac0cb6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c02e070 con 0x7fa5300052c0 2024-04-25T12:50:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f8e8bfff640 1 --2- 172.21.15.132:0/589448697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 0x7f8e8c0c82b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e7802a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ee266e24818064e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa53c005ad0 con 0x7fa5300052c0 2024-04-25T12:50:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7fa546ffd640 1 -- 172.21.15.132:0/1778740511 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa53c007d10 con 0x7fa5300052c0 2024-04-25T12:50:44.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f95aaffd640 1 -- 172.21.15.132:0/3353587263 learned_addr learned my addr 172.21.15.132:0/3353587263 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f8e8b7fe640 1 -- 172.21.15.132:0/589448697 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78037070 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac1515e0 con 0x7f95ac15b260 2024-04-25T12:50:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f8e8b7fe640 1 -- 172.21.15.132:0/589448697 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e78032440 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.304 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f14bb59e640 1 Processor -- start 2024-04-25T12:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f8e8b7fe640 1 -- 172.21.15.132:0/589448697 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e78032810 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f14ee828640 1 -- 172.21.15.132:0/2810161524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e004b9b0 msgr2=0x7f14e004be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f95ac15ad40 con 0x7f95ac151200 2024-04-25T12:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f95ac151760 con 0x7f95ac157530 2024-04-25T12:50:44.305 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95ab7fe640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac0cb6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f14ee828640 1 --2- 172.21.15.132:0/2810161524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e004b9b0 0x7f14e004be20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f14d80097a0 tx=0x7f14d802a2c0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7fe0aad9b640 1 Processor -- start 2024-04-25T12:50:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f2b3e817640 1 -- 172.21.15.132:0/349227348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380c9d90 msgr2=0x7f2b38163240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.306 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f2b3e817640 1 --2- 172.21.15.132:0/349227348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380c9d90 0x7f2b38163240 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2b380c78b0 tx=0x7f2b3002a6f0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7fe0aad9b640 1 -- start start 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95aaffd640 1 -- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95ac157530 msgr2=0x7f95ac155250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95aaffd640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95ac157530 0x7f95ac155250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95aaffd640 1 -- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 msgr2=0x7f95ac0cb6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f2b3e817640 1 -- 172.21.15.132:0/349227348 shutdown_connections 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f2b3e817640 1 --2- 172.21.15.132:0/349227348 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380c9d90 0x7f2b38163240 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f2b3e817640 1 --2- 172.21.15.132:0/349227348 >> v2:172.21.15.132:3300/0 conn(0x7f2b380cc2c0 0x7f2b380c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.307 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f2b3e817640 1 -- 172.21.15.132:0/349227348 >> 172.21.15.132:0/349227348 conn(0x7f2b38072d60 msgr2=0x7f2b38073170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95aaffd640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac0cb6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95aaffd640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac1568d0 con 0x7f95ac151200 2024-04-25T12:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7fa54d06e640 1 -- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 msgr2=0x7fa53000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70101f9f40 con 0x7f70100c75c0 2024-04-25T12:50:44.308 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.271+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f70100713b0 con 0x7f70100c75c0 2024-04-25T12:50:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa53000b9c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa53c001050 tx=0x7fa530005830 comp rx=0 tx=0).stop 2024-04-25T12:50:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7fa54d06e640 1 -- 172.21.15.132:0/1778740511 shutdown_connections 2024-04-25T12:50:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1778740511 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa53000b9c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7fa54d06e640 1 -- 172.21.15.132:0/1778740511 >> 172.21.15.132:0/1778740511 conn(0x7fa54806d1a0 msgr2=0x7fa548072b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f95aaffd640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 0x7f95ac1f0700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f959c00be00 tx=0x7f959c013490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7fa54d06e640 1 -- 172.21.15.132:0/1778740511 shutdown_connections 2024-04-25T12:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14ee828640 1 -- 172.21.15.132:0/2810161524 shutdown_connections 2024-04-25T12:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14ee828640 1 --2- 172.21.15.132:0/2810161524 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e004b9b0 0x7f14e004be20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14ee828640 1 -- 172.21.15.132:0/2810161524 >> 172.21.15.132:0/2810161524 conn(0x7f14e004d4b0 msgr2=0x7f14e004d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.310 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7fa54d06e640 1 -- 172.21.15.132:0/1778740511 wait complete. 2024-04-25T12:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f700400c9d0 con 0x7f70100c75c0 2024-04-25T12:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7010068c20 con 0x7f70100c75c0 2024-04-25T12:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c01d020 con 0x7f95ac151200 2024-04-25T12:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f959c019600 con 0x7f95ac151200 2024-04-25T12:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95ac156030 con 0x7f95ac151200 2024-04-25T12:50:44.311 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14ee828640 1 -- 172.21.15.132:0/2810161524 shutdown_connections 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f2b3e817640 1 -- 172.21.15.132:0/349227348 shutdown_connections 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.272+0000 7f14bb59e640 1 -- start start 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b40d6e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 0x7f14b416fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bb59e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40e3090 0x7f14b40cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bb59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f14b4045980 con 0x7f14b40dd3c0 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bb59e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f14b40e3c30 con 0x7f14b404ba60 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bb59e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f14b4045c60 con 0x7f14b40e3090 2024-04-25T12:50:44.312 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14b9d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 0x7f14b416fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 -- 172.21.15.132:0/589448697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 msgr2=0x7f8e8c0c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 --2- 172.21.15.132:0/589448697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 0x7f8e8c0c82b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8e78009870 tx=0x7f8e7802a250 comp rx=0 tx=0).stop 2024-04-25T12:50:44.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14b9d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 0x7f14b416fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51510/0 (socket says 172.21.15.132:51510) 2024-04-25T12:50:44.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14b9d9b640 1 -- 172.21.15.132:0/1445667018 learned_addr learned my addr 172.21.15.132:0/1445667018 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14ba59c640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b40d6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 -- 172.21.15.132:0/589448697 shutdown_connections 2024-04-25T12:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 --2- 172.21.15.132:0/589448697 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c15f3e0 0x7f8e8c0c82b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 --2- 172.21.15.132:0/589448697 >> v2:172.21.15.157:3300/0 conn(0x7f8e8c0c9920 0x7f8e8c0c9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 -- 172.21.15.132:0/589448697 >> 172.21.15.132:0/589448697 conn(0x7f8e8c067a20 msgr2=0x7f8e8c06b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f2b3e817640 1 -- 172.21.15.132:0/349227348 wait complete. 2024-04-25T12:50:44.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f14bad9d640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40e3090 0x7f14b40cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7fe0aad9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 0x7fe09c0495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 -- 172.21.15.132:0/589448697 shutdown_connections 2024-04-25T12:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7fe0aad9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe09c0f6d80 0x7fe09c1882e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.273+0000 7f8e91b28640 1 -- 172.21.15.132:0/589448697 wait complete. 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0aad9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe09c0472d0 0x7fe09c188820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 0x7fe09c0495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0aad9b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c007260 con 0x7fe09c0f6d80 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0aad9b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe09c006f80 con 0x7fe09c0472d0 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0aad9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe09c0062e0 con 0x7fe09c04b600 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 0x7fe09c0495c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55112/0 (socket says 172.21.15.132:55112) 2024-04-25T12:50:44.316 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 -- 172.21.15.132:0/2080249475 learned_addr learned my addr 172.21.15.132:0/2080249475 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700400cdc0 con 0x7f70100c75c0 2024-04-25T12:50:44.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a3fff640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe09c0f6d80 0x7fe09c1882e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f14b9d9b640 1 -- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40e3090 msgr2=0x7f14b40cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.317 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f14b9d9b640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40e3090 0x7f14b40cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f14b9d9b640 1 -- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 msgr2=0x7f14b40d6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f14b9d9b640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b40d6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 -- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe09c0472d0 msgr2=0x7fe09c188820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe09c0472d0 0x7fe09c188820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 -- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe09c0f6d80 msgr2=0x7fe09c1882e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe09c0f6d80 0x7fe09c1882e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.318 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fe0a8b37640 1 -- 172.21.15.132:0/2080249475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe09c0fc760 con 0x7fe09c04b600 2024-04-25T12:50:44.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f14b9d9b640 1 -- 172.21.15.132:0/1445667018 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b40cfea0 con 0x7f14b40dd3c0 2024-04-25T12:50:44.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7fa54d06e640 1 Processor -- start 2024-04-25T12:50:44.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7fa54d06e640 1 -- start start 2024-04-25T12:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f14b9d9b640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 0x7f14b416fbd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f14bc07ccb0 tx=0x7f14bc06acd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f14bad9d640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40e3090 0x7f14b40cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f14ba59c640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b40d6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f2b3e817640 1 Processor -- start 2024-04-25T12:50:44.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f700401a070 con 0x7f70100c75c0 2024-04-25T12:50:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7fe0a8b37640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 0x7fe09c0495c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c820 tx=0x7fe09400cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f8e91b28640 1 Processor -- start 2024-04-25T12:50:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95ac1565f0 con 0x7f95ac151200 2024-04-25T12:50:44.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f959c0199f0 con 0x7f95ac151200 2024-04-25T12:50:44.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0bd020 con 0x7f14b40dd3c0 2024-04-25T12:50:44.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f14bb59e640 1 -- 172.21.15.132:0/1445667018 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b417c1f0 con 0x7f14b40dd3c0 2024-04-25T12:50:44.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f6ff77fe640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6ffc06c9c0 0x7f6ffc06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f14bb59e640 1 -- 172.21.15.132:0/1445667018 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b417c7b0 con 0x7f14b40dd3c0 2024-04-25T12:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f8e91b28640 1 -- start start 2024-04-25T12:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.275+0000 7f2b3e817640 1 -- start start 2024-04-25T12:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f2b3e817640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 0x7f2b38154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95ac068c20 con 0x7f95ac151200 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f2b3e817640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cc2c0 0x7f2b382010e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f8e91b28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c0c8c40 0x7f8e8c1f58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f8e91b28640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c0c9920 0x7f8e8c0cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f8e91b28640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 0x7f8e8c158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91b28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c073ea0 con 0x7f8e8c0c8c40 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91b28640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f8e8c0c92c0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91b28640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f8e8c160250 con 0x7f8e8c0c9920 2024-04-25T12:50:44.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 0x7f2b38154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 0x7f2b38154660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55128/0 (socket says 172.21.15.132:55128) 2024-04-25T12:50:44.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 -- 172.21.15.132:0/3302917958 learned_addr learned my addr 172.21.15.132:0/3302917958 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380cc6a0 0x7f2b38201620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 0x7f8e8c158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2b380b6690 con 0x7f2b380cc2c0 2024-04-25T12:50:44.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2b380c8e00 con 0x7f2b380cc6a0 2024-04-25T12:50:44.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2b380b6810 con 0x7f2b380c9d90 2024-04-25T12:50:44.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 0x7f8e8c158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39794/0 (socket says 172.21.15.132:39794) 2024-04-25T12:50:44.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 -- 172.21.15.132:0/1795513027 learned_addr learned my addr 172.21.15.132:0/1795513027 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e8bfff640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c0c9920 0x7f8e8c0cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54d06e640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa5481f1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54d06e640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5481e7d60 0x7fa5481f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54d06e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5481531f0 0x7fa54815a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54d06e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa5480d07f0 con 0x7fa5481531f0 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54d06e640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa54815bf90 con 0x7fa5481e7d60 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54d06e640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa5480d0970 con 0x7fa5300052c0 2024-04-25T12:50:44.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3e016640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380cc6a0 0x7f2b38201620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e90b26640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c0c8c40 0x7f8e8c1f58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f700408bf00 con 0x7f70100c75c0 2024-04-25T12:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f700effd640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6ffc06c9c0 0x7f6ffc06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f700effd640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6ffc06c9c0 0x7f6ffc06ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7000000f60 tx=0x7f70000079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54c86d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5481531f0 0x7fa54815a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.328 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54c86d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5481531f0 0x7fa54815a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51536/0 (socket says 172.21.15.132:51536) 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa54c86d640 1 -- 172.21.15.132:0/1296767678 learned_addr learned my addr 172.21.15.132:0/1296767678 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 -- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c0c9920 msgr2=0x7f8e8c0cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c0c9920 0x7f8e8c0cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 -- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c0c8c40 msgr2=0x7f8e8c1f58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c0c8c40 0x7f8e8c1f58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f8e91327640 1 -- 172.21.15.132:0/1795513027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e8c0cc0f0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.329 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa547fff640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa5481f1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d014640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cc2c0 0x7f2b382010e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7fa5477fe640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5481e7d60 0x7fa5481f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.330 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.274+0000 7f14ee828640 1 -- 172.21.15.132:0/2810161524 wait complete. 2024-04-25T12:50:44.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14bc0adb20 con 0x7f14b40dd3c0 2024-04-25T12:50:44.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14bc0b9480 con 0x7f14b40dd3c0 2024-04-25T12:50:44.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.276+0000 7f14ee828640 1 Processor -- start 2024-04-25T12:50:44.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f14bb59e640 1 -- 172.21.15.132:0/1445667018 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a0005290 con 0x7f14b40dd3c0 2024-04-25T12:50:44.331 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f959c020020 con 0x7f95ac151200 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 -- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380cc6a0 msgr2=0x7f2b38201620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380cc6a0 0x7f2b38201620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 -- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cc2c0 msgr2=0x7f2b382010e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.277+0000 7f2b3d815640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cc2c0 0x7f2b382010e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f2b3d815640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b38201c40 con 0x7f2b380c9d90 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f2b3d014640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cc2c0 0x7f2b382010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:44.332 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f8e91327640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 0x7f8e8c158530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c730 tx=0x7f8e8400cb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f14ee828640 1 -- start start 2024-04-25T12:50:44.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7fa547fff640 1 -- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5481e7d60 msgr2=0x7fa5481f4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7fa547fff640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5481e7d60 0x7fa5481f4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.333 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7fa547fff640 1 -- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5481531f0 msgr2=0x7fa54815a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7fa547fff640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5481531f0 0x7fa54815a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7fa547fff640 1 -- 172.21.15.132:0/1296767678 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa548154d40 con 0x7fa5300052c0 2024-04-25T12:50:44.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f2b3d815640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 0x7f2b38154660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400d830 tx=0x7f2b3400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f95937fe640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f959806c9c0 0x7f959806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.334 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7fa547fff640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa5481f1680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa54000f860 tx=0x7fa54000fd20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14bc0c0020 con 0x7f14b40dd3c0 2024-04-25T12:50:44.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f959c0901a0 con 0x7f95ac151200 2024-04-25T12:50:44.335 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f95aa7fc640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f959806c9c0 0x7f959806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.278+0000 7f14aaffd640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f149c06c940 0x7f149c06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ba59c640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f149c06c940 0x7f149c06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f14bc1289a0 con 0x7f14b40dd3c0 2024-04-25T12:50:44.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee828640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 0x7f14e00db860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.336 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f95aa7fc640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f959806c9c0 0x7f959806ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95a4034000 tx=0x7f95a4039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee828640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e00db210 0x7f14e00cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.337 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ba59c640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f149c06c940 0x7f149c06ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009f30 tx=0x7f14ac009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 0x7f14e00db860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee828640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e00dc700 0x7f14e00ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee828640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f14e004cfb0 con 0x7f14e00dc700 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee828640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f14e0007d70 con 0x7f14e00db210 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 0x7f14e00db860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55170/0 (socket says 172.21.15.132:55170) 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 -- 172.21.15.132:0/967327695 learned_addr learned my addr 172.21.15.132:0/967327695 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:44.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f14e004d130 con 0x7f14e004b9b0 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed025640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e00db210 0x7f14e00cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee027640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e00dc700 0x7f14e00ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 -- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e00db210 msgr2=0x7f14e00cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e00db210 0x7f14e00cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 -- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e00dc700 msgr2=0x7f14e00ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e00dc700 0x7f14e00ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ed826640 1 -- 172.21.15.132:0/967327695 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14e00d83a0 con 0x7f14e004b9b0 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.279+0000 7f14ee027640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e00dc700 0x7f14e00ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f14ed826640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 0x7f14e00db860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c480 tx=0x7f14e400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e40052d0 con 0x7f14e004b9b0 2024-04-25T12:50:44.339 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400b6c0 con 0x7f2b380c9d90 2024-04-25T12:50:44.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa540003b80 con 0x7fa5300052c0 2024-04-25T12:50:44.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094015070 con 0x7fe09c04b600 2024-04-25T12:50:44.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14e00d8640 con 0x7f14e004b9b0 2024-04-25T12:50:44.340 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe094007a30 con 0x7fe09c04b600 2024-04-25T12:50:44.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5480c7670 con 0x7fa5300052c0 2024-04-25T12:50:44.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5480c7390 con 0x7fa5300052c0 2024-04-25T12:50:44.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f14e00d6ee0 con 0x7f14e004b9b0 2024-04-25T12:50:44.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa540018070 con 0x7fa5300052c0 2024-04-25T12:50:44.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09c185e60 con 0x7fe09c04b600 2024-04-25T12:50:44.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09c186b70 con 0x7fe09c04b600 2024-04-25T12:50:44.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe094007de0 con 0x7fe09c04b600 2024-04-25T12:50:44.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14e4005470 con 0x7f14e004b9b0 2024-04-25T12:50:44.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.281+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f70101f7900 con 0x7f70100c75c0 2024-04-25T12:50:44.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2b34019070 con 0x7f2b380c9d90 2024-04-25T12:50:44.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.280+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b3400ba80 con 0x7f2b380c9d90 2024-04-25T12:50:44.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.281+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa54000d730 con 0x7fa5300052c0 2024-04-25T12:50:44.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.281+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14e4012870 con 0x7f14e004b9b0 2024-04-25T12:50:44.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.281+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14d0005290 con 0x7f14e004b9b0 2024-04-25T12:50:44.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.282+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe084005290 con 0x7fe09c04b600 2024-04-25T12:50:44.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.282+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5480741e0 con 0x7fa5300052c0 2024-04-25T12:50:44.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.282+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa54000d950 con 0x7fa5300052c0 2024-04-25T12:50:44.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f14e4012a50 con 0x7f14e004b9b0 2024-04-25T12:50:44.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b380c5670 con 0x7f2b380c9d90 2024-04-25T12:50:44.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b38153e60 con 0x7f2b380c9d90 2024-04-25T12:50:44.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7fa544ff9640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa53406c8f0 0x7fa53406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84016020 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f14de7fc640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f14cc06c8f0 0x7f14cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e84006d50 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e8c0cc360 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e8c0cc920 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7fa5477fe640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa53406c8f0 0x7fa53406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.283+0000 7f14ed025640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f14cc06c8f0 0x7f14cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.347 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b380c4610 con 0x7f2b380c9d90 2024-04-25T12:50:44.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f14e408b9d0 con 0x7f14e004b9b0 2024-04-25T12:50:44.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7f14ed025640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f14cc06c8f0 0x7f14cc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14d8034000 tx=0x7f14d802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa54008bda0 con 0x7fa5300052c0 2024-04-25T12:50:44.348 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e84003bb0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f959c041020 con 0x7f95ac151200 2024-04-25T12:50:44.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.284+0000 7fa5477fe640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa53406c8f0 0x7fa53406edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5480b6410 tx=0x7fa538009060 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.285+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe094018070 con 0x7fe09c04b600 2024-04-25T12:50:44.349 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.285+0000 7fe0a17fa640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09006c8f0 0x7fe09006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.285+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e8c0741e0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.286+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe09408be50 con 0x7fe09c04b600 2024-04-25T12:50:44.350 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.286+0000 7fe0a3fff640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09006c8f0 0x7fe09006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.286+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14bc0c7030 con 0x7f14b40dd3c0 2024-04-25T12:50:44.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.286+0000 7fe0a3fff640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09006c8f0 0x7fe09006edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe098037000 tx=0x7fe098030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.351 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.286+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e840050d0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.287+0000 7f8e897fa640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8e7006c8f0 0x7f8e7006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.287+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8e8408ba70 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.287+0000 7f8e90b26640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8e7006c8f0 0x7f8e7006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.287+0000 7f8e90b26640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8e7006c8f0 0x7f8e7006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e80006fd0 tx=0x7f8e80008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.352 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.288+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f14e4059460 con 0x7f14e004b9b0 2024-04-25T12:50:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.289+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2b3401e460 con 0x7f2b380c9d90 2024-04-25T12:50:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.289+0000 7f2b2e7fc640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2b1c06c8f0 0x7f2b1c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.289+0000 7f2b3d014640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2b1c06c8f0 0x7f2b1c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.290+0000 7f2b3d014640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2b1c06c8f0 0x7f2b1c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b28006fd0 tx=0x7f2b28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.291+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e84020020 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.353 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.292+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa5400597b0 con 0x7fa5300052c0 2024-04-25T12:50:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.296+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2b34058b00 con 0x7f2b380c9d90 2024-04-25T12:50:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.297+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe094059960 con 0x7fe09c04b600 2024-04-25T12:50:44.354 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.301+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2b380c4610 con 0x7f2b380c9d90 2024-04-25T12:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.698+0000 7f14bb59e640 1 -- 172.21.15.132:0/1445667018 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f14a0005850 con 0x7f14b40dd3c0 2024-04-25T12:50:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.699+0000 7f14aaffd640 1 -- 172.21.15.132:0/1445667018 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14b40dd7a0 con 0x7f14b40dd3c0 2024-04-25T12:50:44.698 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2024-04-25T12:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.702+0000 7f14a8ff9640 1 -- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f149c06c940 msgr2=0x7f149c06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.702+0000 7f14a8ff9640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f149c06c940 0x7f149c06ee00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f14ac009f30 tx=0x7f14ac009190 comp rx=0 tx=0).stop 2024-04-25T12:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.702+0000 7f14a8ff9640 1 -- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 msgr2=0x7f14b416fbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.703+0000 7f14a8ff9640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 0x7f14b416fbd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f14bc07ccb0 tx=0x7f14bc06acd0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.704+0000 7f14a8ff9640 1 -- 172.21.15.132:0/1445667018 shutdown_connections 2024-04-25T12:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.704+0000 7f14a8ff9640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f149c06c940 0x7f149c06ee00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.704+0000 7f14a8ff9640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14b40e3090 0x7f14b40cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.704+0000 7f14a8ff9640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14b40dd3c0 0x7f14b416fbd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.704+0000 7f14a8ff9640 1 --2- 172.21.15.132:0/1445667018 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14b404ba60 0x7f14b40d6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.704+0000 7f14a8ff9640 1 -- 172.21.15.132:0/1445667018 >> 172.21.15.132:0/1445667018 conn(0x7f14b4050180 msgr2=0x7f14b4005e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.707+0000 7f14a8ff9640 1 -- 172.21.15.132:0/1445667018 shutdown_connections 2024-04-25T12:50:44.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.707+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f70101656a0 con 0x7f70100c75c0 2024-04-25T12:50:44.705 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.707+0000 7f14a8ff9640 1 -- 172.21.15.132:0/1445667018 wait complete. 2024-04-25T12:50:44.708 INFO:teuthology.orchestra.run.smithi132.stdout:60129542155 2024-04-25T12:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.708+0000 7f6ff77fe640 1 -- 172.21.15.132:0/1303971210 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7004059980 con 0x7f70100c75c0 2024-04-25T12:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.710+0000 7f95b1607640 1 -- 172.21.15.132:0/3353587263 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f95ac0c8570 con 0x7f95ac151200 2024-04-25T12:50:44.709 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.711+0000 7f95937fe640 1 -- 172.21.15.132:0/3353587263 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f95ac1568d0 con 0x7f95ac151200 2024-04-25T12:50:44.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.711+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6ffc06c9c0 msgr2=0x7f6ffc06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.710 INFO:teuthology.orchestra.run.smithi132.stdout:60129542154 2024-04-25T12:50:44.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.711+0000 7f70155f9640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6ffc06c9c0 0x7f6ffc06ee80 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7000000f60 tx=0x7f70000079b0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 msgr2=0x7f70101f7c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 0x7f70101f7c00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f700400e9e0 tx=0x7f700400eea0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 shutdown_connections 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6ffc06c9c0 0x7f6ffc06ee80 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70100cc470 0x7f70101604a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f70100c75c0 0x7f70101f7c00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 --2- 172.21.15.132:0/1303971210 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f70100c53d0 0x7f70100c2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 >> 172.21.15.132:0/1303971210 conn(0x7f7010067630 msgr2=0x7f7010067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 shutdown_connections 2024-04-25T12:50:44.712 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.712+0000 7f70155f9640 1 -- 172.21.15.132:0/1303971210 wait complete. 2024-04-25T12:50:44.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f14d0005580 con 0x7f14e004b9b0 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 -- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f959806c9c0 msgr2=0x7f959806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f959806c9c0 0x7f959806ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f95a4034000 tx=0x7f95a4039040 comp rx=0 tx=0).stop 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 -- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 msgr2=0x7f95ac1f0700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 0x7f95ac1f0700 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f959c00be00 tx=0x7f959c013490 comp rx=0 tx=0).stop 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 -- 172.21.15.132:0/3353587263 shutdown_connections 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f959806c9c0 0x7f959806ee80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95ac15b260 0x7f95ac0cb6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f95ac157530 0x7f95ac155250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 --2- 172.21.15.132:0/3353587263 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f95ac151200 0x7f95ac1f0700 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f95917fa640 1 -- 172.21.15.132:0/3353587263 >> 172.21.15.132:0/3353587263 conn(0x7f95ac067630 msgr2=0x7f95ac071df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.715+0000 7f14de7fc640 1 -- 172.21.15.132:0/967327695 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f14e405d760 con 0x7f14e004b9b0 2024-04-25T12:50:44.715 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2024-04-25T12:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.716+0000 7f95917fa640 1 -- 172.21.15.132:0/3353587263 shutdown_connections 2024-04-25T12:50:44.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.716+0000 7f95917fa640 1 -- 172.21.15.132:0/3353587263 wait complete. 2024-04-25T12:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.718+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2b380741e0 con 0x7f2b380c9d90 2024-04-25T12:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.718+0000 7f2b2e7fc640 1 -- 172.21.15.132:0/3302917958 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b3405b160 con 0x7f2b380c9d90 2024-04-25T12:50:44.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.719+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f14cc06c8f0 msgr2=0x7f14cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.719+0000 7f14ee828640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f14cc06c8f0 0x7f14cc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f14d8034000 tx=0x7f14d802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.719+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 msgr2=0x7f14e00db860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.719+0000 7f14ee828640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 0x7f14e00db860 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f14e400c480 tx=0x7f14e400c940 comp rx=0 tx=0).stop 2024-04-25T12:50:44.718 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2024-04-25T12:50:44.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 shutdown_connections 2024-04-25T12:50:44.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f14cc06c8f0 0x7f14cc06edb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14e00dc700 0x7f14e00ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f14e00db210 0x7f14e00cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 --2- 172.21.15.132:0/967327695 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f14e004b9b0 0x7f14e00db860 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 >> 172.21.15.132:0/967327695 conn(0x7f14e004d4b0 msgr2=0x7f14e00d8fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 shutdown_connections 2024-04-25T12:50:44.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.720+0000 7f14ee828640 1 -- 172.21.15.132:0/967327695 wait complete. 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2b1c06c8f0 msgr2=0x7f2b1c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2b1c06c8f0 0x7f2b1c06edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2b28006fd0 tx=0x7f2b28008040 comp rx=0 tx=0).stop 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 msgr2=0x7f2b38154660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 0x7f2b38154660 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b3400d830 tx=0x7f2b3400dcf0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 shutdown_connections 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2b1c06c8f0 0x7f2b1c06edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2b380cc6a0 0x7f2b38201620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b380cc2c0 0x7f2b382010e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 --2- 172.21.15.132:0/3302917958 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2b380c9d90 0x7f2b38154660 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 >> 172.21.15.132:0/3302917958 conn(0x7f2b38072d60 msgr2=0x7f2b380c4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 shutdown_connections 2024-04-25T12:50:44.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.722+0000 7f2b3e817640 1 -- 172.21.15.132:0/3302917958 wait complete. 2024-04-25T12:50:44.724 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-04-25T12:50:44.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.730+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fa5480cc270 con 0x7fa5300052c0 2024-04-25T12:50:44.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.731+0000 7fa544ff9640 1 -- 172.21.15.132:0/1296767678 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa54005dab0 con 0x7fa5300052c0 2024-04-25T12:50:44.729 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:44.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.735+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa53406c8f0 msgr2=0x7fa53406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.735+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa53406c8f0 0x7fa53406edb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa5480b6410 tx=0x7fa538009060 comp rx=0 tx=0).stop 2024-04-25T12:50:44.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.735+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 msgr2=0x7fa5481f1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.735+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa5481f1680 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa54000f860 tx=0x7fa54000fd20 comp rx=0 tx=0).stop 2024-04-25T12:50:44.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.735+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 shutdown_connections 2024-04-25T12:50:44.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa53406c8f0 0x7fa53406edb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa5481531f0 0x7fa54815a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa5481e7d60 0x7fa5481f4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 --2- 172.21.15.132:0/1296767678 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa5300052c0 0x7fa5481f1680 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 >> 172.21.15.132:0/1296767678 conn(0x7fa54806d1a0 msgr2=0x7fa5480c8d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 shutdown_connections 2024-04-25T12:50:44.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.736+0000 7fa54d06e640 1 -- 172.21.15.132:0/1296767678 wait complete. 2024-04-25T12:50:44.736 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574859 for osd.6 2024-04-25T12:50:44.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542155 for osd.0 2024-04-25T12:50:44.737 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.1 2024-04-25T12:50:44.738 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.5 2024-04-25T12:50:44.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.751+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f8e8c0c7ee0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.4 2024-04-25T12:50:44.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.751+0000 7f8e897fa640 1 -- 172.21.15.132:0/1795513027 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8e84059ad0 con 0x7f8e8c15f3e0 2024-04-25T12:50:44.750 INFO:teuthology.orchestra.run.smithi132.stdout:55834574857 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8e7006c8f0 msgr2=0x7f8e7006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8e7006c8f0 0x7f8e7006edb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8e80006fd0 tx=0x7f8e80008040 comp rx=0 tx=0).stop 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 msgr2=0x7f8e8c158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 0x7f8e8c158530 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8e8400c730 tx=0x7f8e8400cb30 comp rx=0 tx=0).stop 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 shutdown_connections 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f8e7006c8f0 0x7f8e7006edb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f8e8c15f3e0 0x7f8e8c158530 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f8e8c0c9920 0x7f8e8c0cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 --2- 172.21.15.132:0/1795513027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e8c0c8c40 0x7f8e8c1f58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 >> 172.21.15.132:0/1795513027 conn(0x7f8e8c067a20 msgr2=0x7f8e8c15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 shutdown_connections 2024-04-25T12:50:44.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.754+0000 7f8e91b28640 1 -- 172.21.15.132:0/1795513027 wait complete. 2024-04-25T12:50:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.758+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fe084005850 con 0x7fe09c04b600 2024-04-25T12:50:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.758+0000 7fe0a17fa640 1 -- 172.21.15.132:0/2080249475 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe09405dc60 con 0x7fe09c04b600 2024-04-25T12:50:44.757 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09006c8f0 msgr2=0x7fe09006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09006c8f0 0x7fe09006edb0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe098037000 tx=0x7fe098030000 comp rx=0 tx=0).stop 2024-04-25T12:50:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 msgr2=0x7fe09c0495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 0x7fe09c0495c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe09400c820 tx=0x7fe09400cce0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 shutdown_connections 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe09006c8f0 0x7fe09006edb0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe09c0472d0 0x7fe09c188820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe09c0f6d80 0x7fe09c1882e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 --2- 172.21.15.132:0/2080249475 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe09c04b600 0x7fe09c0495c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 >> 172.21.15.132:0/2080249475 conn(0x7fe09c0501b0 msgr2=0x7fe09c0f15f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 shutdown_connections 2024-04-25T12:50:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:44.761+0000 7fe0aad9b640 1 -- 172.21.15.132:0/2080249475 wait complete. 2024-04-25T12:50:44.763 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.7 2024-04-25T12:50:44.770 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574858 for osd.2 2024-04-25T12:50:45.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T12:50:45.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-25T12:50:45.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T12:50:45.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T12:50:45.739 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T12:50:45.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T12:50:45.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-25T12:50:45.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T12:50:45.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.875+0000 7f7b6474f640 1 Processor -- start 2024-04-25T12:50:45.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.875+0000 7f7b6474f640 1 -- start start 2024-04-25T12:50:45.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.876+0000 7f7b6474f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7b5c0c4030 0x7f7b5c0cc9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.876+0000 7f7b6474f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b5c1579f0 0x7f7b5c161b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.876+0000 7f7b6474f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b5c1518a0 con 0x7f7b5c0cc600 2024-04-25T12:50:45.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.876+0000 7f7b6474f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5c15b780 con 0x7f7b5c1579f0 2024-04-25T12:50:45.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.876+0000 7f7b6474f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7b5c15b4a0 con 0x7f7b5c0c4030 2024-04-25T12:50:45.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.877+0000 7f7b624eb640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f7b5c0cc600 0x7f7b5c1572e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60818/0 (socket says 172.21.15.132:60818) 2024-04-25T12:50:45.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.877+0000 7f7b624eb640 1 -- 172.21.15.132:0/1982141442 learned_addr learned my addr 172.21.15.132:0/1982141442 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:45.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.877+0000 7f7b62cec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b5c1579f0 0x7f7b5c161b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.878+0000 7f7b62cec640 1 -- 172.21.15.132:0/1982141442 >> v2:172.21.15.157:3300/0 conn(0x7f7b5c0c4030 msgr2=0x7f7b5c0cc9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-25T12:50:45.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.878+0000 7f7b62cec640 1 --2- 172.21.15.132:0/1982141442 >> v2:172.21.15.157:3300/0 conn(0x7f7b5c0c4030 0x7f7b5c0cc9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.878+0000 7f7b62cec640 1 -- 172.21.15.132:0/1982141442 >> v1:172.21.15.157:6789/0 conn(0x7f7b5c0cc600 legacy=0x7f7b5c1572e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.878+0000 7f7b62cec640 1 -- 172.21.15.132:0/1982141442 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c0c8950 con 0x7f7b5c1579f0 2024-04-25T12:50:45.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.880+0000 7f7b62cec640 1 --2- 172.21.15.132:0/1982141442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c1579f0 0x7f7b5c161b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0c8f30 tx=0x7f7b4c02a150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23075def65331b50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.880+0000 7f7b614e9640 1 -- 172.21.15.132:0/1982141442 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c037070 con 0x7f7b5c1579f0 2024-04-25T12:50:45.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.880+0000 7f7b614e9640 1 -- 172.21.15.132:0/1982141442 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b4c02ade0 con 0x7f7b5c1579f0 2024-04-25T12:50:45.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.880+0000 7f7b614e9640 1 -- 172.21.15.132:0/1982141442 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b4c032660 con 0x7f7b5c1579f0 2024-04-25T12:50:45.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.882+0000 7f7b6474f640 1 -- 172.21.15.132:0/1982141442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c1579f0 msgr2=0x7f7b5c161b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.882+0000 7f7b6474f640 1 --2- 172.21.15.132:0/1982141442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c1579f0 0x7f7b5c161b60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c0c8f30 tx=0x7f7b4c02a150 comp rx=0 tx=0).stop 2024-04-25T12:50:45.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.882+0000 7f7b6474f640 1 -- 172.21.15.132:0/1982141442 shutdown_connections 2024-04-25T12:50:45.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.882+0000 7f7b6474f640 1 --2- 172.21.15.132:0/1982141442 >> v2:172.21.15.157:3300/0 conn(0x7f7b5c0c4030 0x7f7b5c0cc9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.882+0000 7f7b6474f640 1 --2- 172.21.15.132:0/1982141442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c1579f0 0x7f7b5c161b60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.882+0000 7f7b6474f640 1 -- 172.21.15.132:0/1982141442 >> 172.21.15.132:0/1982141442 conn(0x7f7b5c075db0 msgr2=0x7f7b5c067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.883+0000 7f7b6474f640 1 -- 172.21.15.132:0/1982141442 shutdown_connections 2024-04-25T12:50:45.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.883+0000 7f7b6474f640 1 -- 172.21.15.132:0/1982141442 wait complete. 2024-04-25T12:50:45.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.885+0000 7f7b6474f640 1 Processor -- start 2024-04-25T12:50:45.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.885+0000 7f7b6474f640 1 -- start start 2024-04-25T12:50:45.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.886+0000 7f7b6474f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b5c0c4030 0x7f7b5c150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.886+0000 7f7b6474f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 0x7f7b5c153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b61cea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 0x7f7b5c153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b624eb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b5c0c4030 0x7f7b5c150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b624eb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b5c0c4030 0x7f7b5c150a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55178/0 (socket says 172.21.15.132:55178) 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b61cea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 0x7f7b5c153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51568/0 (socket says 172.21.15.132:51568) 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b624eb640 1 -- 172.21.15.132:0/3022211987 learned_addr learned my addr 172.21.15.132:0/3022211987 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b6474f640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b5c1579f0 0x7f7b5c156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.887+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c0c7d10 con 0x7f7b5c0cc600 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5c0c7a30 con 0x7f7b5c1579f0 2024-04-25T12:50:45.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7b5c15b190 con 0x7f7b5c0c4030 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b61cea640 1 -- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b5c0c4030 msgr2=0x7f7b5c150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b61cea640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b5c0c4030 0x7f7b5c150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b61cea640 1 -- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b5c1579f0 msgr2=0x7f7b5c156530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b61cea640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b5c1579f0 0x7f7b5c156530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.888+0000 7f7b61cea640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5c162d60 con 0x7f7b5c0cc600 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.889+0000 7f7b61cea640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 0x7f7b5c153e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400a430 tx=0x7f7b5400a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.890+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5401c020 con 0x7f7b5c0cc600 2024-04-25T12:50:45.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.890+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b5c154a80 con 0x7f7b5c0cc600 2024-04-25T12:50:45.889 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.890+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b5c06f100 con 0x7f7b5c0cc600 2024-04-25T12:50:45.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.893+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b5400f500 con 0x7f7b5c0cc600 2024-04-25T12:50:45.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.893+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5401f550 con 0x7f7b5c0cc600 2024-04-25T12:50:45.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.893+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7b5401f020 con 0x7f7b5c0cc600 2024-04-25T12:50:45.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.893+0000 7f7b52ffd640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b4006ca20 0x7f7b4006eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.894+0000 7f7b624eb640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b4006ca20 0x7f7b4006eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.895+0000 7f7b624eb640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b4006ca20 0x7f7b4006eee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b58000f60 tx=0x7f7b58000ed0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.895+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7b54094eb0 con 0x7f7b5c0cc600 2024-04-25T12:50:45.894 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.896+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b44005290 con 0x7f7b5c0cc600 2024-04-25T12:50:45.904 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.906+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7b54026020 con 0x7f7b5c0cc600 2024-04-25T12:50:45.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.936+0000 7f2f369c8640 1 Processor -- start 2024-04-25T12:50:45.934 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.936+0000 7f2f369c8640 1 -- start start 2024-04-25T12:50:45.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.936+0000 7fa8fb2c0640 1 Processor -- start 2024-04-25T12:50:45.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.936+0000 7fa8fb2c0640 1 -- start start 2024-04-25T12:50:45.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.936+0000 7f3e42f87640 1 Processor -- start 2024-04-25T12:50:45.935 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.936+0000 7f3e42f87640 1 -- start start 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e42f87640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3e3c0cc4e0 0x7f3e3c0c7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e42f87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 0x7f3e3c0c7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e42f87640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e3c0ccdb0 con 0x7f3e3c16c130 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e42f87640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3e3c168350 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e42f87640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3c168630 con 0x7f3e3c0cc930 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e3bfff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3e3c0cc4e0 0x7f3e3c0c7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f2f369c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2f301596a0 0x7f2f3006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f2f369c8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f3015f840 con 0x7f2f300c8b40 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f369c8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f3015fb20 con 0x7f2f300c4ee0 2024-04-25T12:50:45.936 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f369c8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2f301603c0 con 0x7f2f301596a0 2024-04-25T12:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e41524640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 0x7f3e3c0c7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f351c5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2f300c8b40 0x7f2f3006e2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36982/0 (socket says 172.21.15.132:36982) 2024-04-25T12:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f351c5640 1 -- 172.21.15.132:0/1915545137 learned_addr learned my addr 172.21.15.132:0/1915545137 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f359c6640 1 --2- 172.21.15.132:0/1915545137 >> v2:172.21.15.132:3300/0 conn(0x7f2f301596a0 0x7f2f3006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fb2c0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 0x7fa8ec0d51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fb2c0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa8ec0dce00 0x7fa8ec04bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fb2c0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8ec0071e0 con 0x7fa8ec04b9a0 2024-04-25T12:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fb2c0640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa8ec0d5730 con 0x7fa8ec0dce00 2024-04-25T12:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fb2c0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec0080d0 con 0x7fa8ec0db200 2024-04-25T12:50:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fa2be640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 0x7fa8ec0d51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fa2be640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 0x7fa8ec0d51f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55192/0 (socket says 172.21.15.132:55192) 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fa2be640 1 -- 172.21.15.132:0/2088205158 learned_addr learned my addr 172.21.15.132:0/2088205158 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8faabf640 1 --2- 172.21.15.132:0/2088205158 >> v2:172.21.15.157:3300/0 conn(0x7fa8ec0dce00 0x7fa8ec04bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fa2be640 1 -- 172.21.15.132:0/2088205158 >> v2:172.21.15.157:3300/0 conn(0x7fa8ec0dce00 msgr2=0x7fa8ec04bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7fa8fa2be640 1 --2- 172.21.15.132:0/2088205158 >> v2:172.21.15.157:3300/0 conn(0x7fa8ec0dce00 0x7fa8ec04bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616663680 0 0) 0x7f2f3015f840 con 0x7f2f300c8b40 2024-04-25T12:50:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7fa8fa2be640 1 -- 172.21.15.132:0/2088205158 >> v1:172.21.15.132:6789/0 conn(0x7fa8ec04b9a0 legacy=0x7fa8ec0dc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7fa8fa2be640 1 -- 172.21.15.132:0/2088205158 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0074c0 con 0x7fa8ec0db200 2024-04-25T12:50:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7fa8faabf640 1 --2- 172.21.15.132:0/2088205158 >> v2:172.21.15.157:3300/0 conn(0x7fa8ec0dce00 0x7fa8ec04bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.937+0000 7f3e41524640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 0x7f3e3c0c7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55180/0 (socket says 172.21.15.132:55180) 2024-04-25T12:50:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f3e41524640 1 -- 172.21.15.132:0/2270698398 learned_addr learned my addr 172.21.15.132:0/2270698398 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f3e41524640 1 -- 172.21.15.132:0/2270698398 >> v2:172.21.15.157:3300/0 conn(0x7f3e3c0cc4e0 msgr2=0x7f3e3c0c7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:45.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f3e41524640 1 --2- 172.21.15.132:0/2270698398 >> v2:172.21.15.157:3300/0 conn(0x7f3e3c0cc4e0 0x7f3e3c0c7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f3e41524640 1 -- 172.21.15.132:0/2270698398 >> v1:172.21.15.132:6789/0 conn(0x7f3e3c16c130 legacy=0x7f3e3c162150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:45.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f3e41524640 1 -- 172.21.15.132:0/2270698398 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c168910 con 0x7f3e3c0cc930 2024-04-25T12:50:45.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f1c003520 con 0x7f2f300c8b40 2024-04-25T12:50:45.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7fe976dd8640 1 Processor -- start 2024-04-25T12:50:45.942 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7fe976dd8640 1 -- start start 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535668886 0 0) 0x7f2f3015fb20 con 0x7f2f300c4ee0 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.938+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f3015f840 con 0x7f2f300c4ee0 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.1 v1:172.21.15.157:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 615954191 0 0) 0x7f2f3015f840 con 0x7f2f300c4ee0 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 >> v2:172.21.15.132:3300/0 conn(0x7f2f301596a0 msgr2=0x7f2f3006ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 --2- 172.21.15.132:0/1915545137 >> v2:172.21.15.132:3300/0 conn(0x7f2f301596a0 0x7f2f3006ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 >> v1:172.21.15.132:6789/0 conn(0x7f2f300c8b40 legacy=0x7f2f3006e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 --> v1:172.21.15.157:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3015fe00 con 0x7f2f300c4ee0 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.1 v1:172.21.15.157:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f2f28001950 con 0x7f2f300c4ee0 2024-04-25T12:50:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 >> v1:172.21.15.157:6789/0 conn(0x7f2f300c4ee0 legacy=0x7f2f300c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f1c004ba0 0x7f2f1c004f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c0037a0 0x7f2f1c003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f1c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fa8fa2be640 1 --2- 172.21.15.132:0/2088205158 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 0x7fa8ec0d51f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009870 tx=0x7fa8f002a250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12d368ac9facdc53 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2f301603c0 con 0x7f2f1c004160 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2f1c00c010 con 0x7f2f1c0037a0 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2f1c00c210 con 0x7f2f1c004ba0 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f359c6640 1 --2- 172.21.15.132:0/1915545137 >> v2:172.21.15.132:3300/0 conn(0x7f2f301596a0 0x7f2f3006ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.939+0000 7f2f361c7640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f1c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f351c5640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c0037a0 0x7f2f1c003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f359c6640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f1c004ba0 0x7f2f1c004f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f3e41524640 1 --2- 172.21.15.132:0/2270698398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 0x7f3e3c0c7b70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400bef0 tx=0x7f3e340093b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a913a78dee92ba8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f361c7640 1 -- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f1c004ba0 msgr2=0x7f2f1c004f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:45.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f3e3b7fe640 1 -- 172.21.15.132:0/2270698398 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e34036070 con 0x7f3e3c0cc930 2024-04-25T12:50:45.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f3e3b7fe640 1 -- 172.21.15.132:0/2270698398 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e34009600 con 0x7f3e3c0cc930 2024-04-25T12:50:45.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fa8f92bc640 1 -- 172.21.15.132:0/2088205158 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0037070 con 0x7fa8ec0db200 2024-04-25T12:50:45.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fa8f92bc640 1 -- 172.21.15.132:0/2088205158 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8f0032440 con 0x7fa8ec0db200 2024-04-25T12:50:45.946 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fa8f92bc640 1 -- 172.21.15.132:0/2088205158 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8f0032810 con 0x7fa8ec0db200 2024-04-25T12:50:45.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f361c7640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f1c004ba0 0x7f2f1c004f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f361c7640 1 -- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c0037a0 msgr2=0x7f2f1c003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:45.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f361c7640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f1c0037a0 0x7f2f1c003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.947 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7f2f361c7640 1 -- 172.21.15.132:0/1915545137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f3015fe00 con 0x7f2f1c004160 2024-04-25T12:50:45.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fe976dd8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 0x7fe9700c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fe976dd8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe9700c61a0 0x7fe9700ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fe976dd8640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe970158ee0 con 0x7fe970153190 2024-04-25T12:50:45.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fe976dd8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe970073fe0 con 0x7fe9700c61a0 2024-04-25T12:50:45.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f3e42f87640 1 -- 172.21.15.132:0/2270698398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 msgr2=0x7f3e3c0c7b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f3e42f87640 1 --2- 172.21.15.132:0/2270698398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 0x7f3e3c0c7b70 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3e3400bef0 tx=0x7f3e340093b0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fb2ce1a3640 1 Processor -- start 2024-04-25T12:50:45.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fb2ce1a3640 1 -- start start 2024-04-25T12:50:45.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/2088205158 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 msgr2=0x7fa8ec0d51f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.949 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fa8fb2c0640 1 --2- 172.21.15.132:0/2088205158 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 0x7fa8ec0d51f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0009870 tx=0x7fa8f002a250 comp rx=0 tx=0).stop 2024-04-25T12:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f2f361c7640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f1c00b9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c510 tx=0x7f2f1c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdd179692fb136f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f2f361c7640 1 -- 172.21.15.132:0/1915545137 reap_dead start 2024-04-25T12:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f3e42f87640 1 -- 172.21.15.132:0/2270698398 shutdown_connections 2024-04-25T12:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f3e42f87640 1 --2- 172.21.15.132:0/2270698398 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc930 0x7f3e3c0c7b70 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f3e42f87640 1 --2- 172.21.15.132:0/2270698398 >> v2:172.21.15.157:3300/0 conn(0x7f3e3c0cc4e0 0x7f3e3c0c7630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.950 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7f3e42f87640 1 -- 172.21.15.132:0/2270698398 >> 172.21.15.132:0/2270698398 conn(0x7f3e3c075db0 msgr2=0x7f3e3c067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fb2ce1a3640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fb2c000e290 0x7fb2c00d5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.940+0000 7fe976dd8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe9701591b0 con 0x7fe970073bc0 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 0x7fe9700c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 0x7fe9700c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55200/0 (socket says 172.21.15.132:55200) 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 -- 172.21.15.132:0/3806357334 learned_addr learned my addr 172.21.15.132:0/3806357334 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 -- 172.21.15.132:0/3806357334 >> v2:172.21.15.132:3300/0 conn(0x7fe9700c61a0 msgr2=0x7fe9700ccaa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 --2- 172.21.15.132:0/3806357334 >> v2:172.21.15.132:3300/0 conn(0x7fe9700c61a0 0x7fe9700ccaa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 -- 172.21.15.132:0/3806357334 >> v1:172.21.15.157:6789/0 conn(0x7fe970153190 legacy=0x7fe9700c6f50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:45.951 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fe96ffff640 1 -- 172.21.15.132:0/3806357334 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe970159490 con 0x7fe970073bc0 2024-04-25T12:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7f3e42f87640 1 -- 172.21.15.132:0/2270698398 shutdown_connections 2024-04-25T12:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.941+0000 7fc225efb640 1 Processor -- start 2024-04-25T12:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fc225efb640 1 -- start start 2024-04-25T12:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fb2ce1a3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c0045ec0 con 0x7fb2c004b610 2024-04-25T12:50:45.952 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fb2ce1a3640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2c0046f20 con 0x7fb2c004b080 2024-04-25T12:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fb2ce1a3640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fb2c004ba60 con 0x7fb2c000e290 2024-04-25T12:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7f3e42f87640 1 -- 172.21.15.132:0/2270698398 wait complete. 2024-04-25T12:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28032020 con 0x7f2f1c004160 2024-04-25T12:50:45.953 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28003b90 con 0x7f2f1c004160 2024-04-25T12:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fb2cd9a2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb2c004b610 0x7fb2c0005e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37010/0 (socket says 172.21.15.132:37010) 2024-04-25T12:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/2088205158 shutdown_connections 2024-04-25T12:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fa8fb2c0640 1 --2- 172.21.15.132:0/2088205158 >> v2:172.21.15.157:3300/0 conn(0x7fa8ec0dce00 0x7fa8ec04bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fa8fb2c0640 1 --2- 172.21.15.132:0/2088205158 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0db200 0x7fa8ec0d51f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/2088205158 >> 172.21.15.132:0/2088205158 conn(0x7fa8ec04d4a0 msgr2=0x7fa8ec04d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.954 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7f2f349c4640 1 -- 172.21.15.132:0/1915545137 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28032020 con 0x7f2f1c004160 2024-04-25T12:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fb2cd9a2640 1 -- 172.21.15.132:0/729406449 learned_addr learned my addr 172.21.15.132:0/729406449 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fe96ffff640 1 --2- 172.21.15.132:0/3806357334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 0x7fe9700c5c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe960009870 tx=0x7fe96002a2c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8ef4f5d8acd2820 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/2088205158 shutdown_connections 2024-04-25T12:50:45.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/2088205158 wait complete. 2024-04-25T12:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.942+0000 7fb2cd1a1640 1 --2- 172.21.15.132:0/729406449 >> v2:172.21.15.157:3300/0 conn(0x7fb2c000e290 0x7fb2c00d5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fe96f7fe640 1 -- 172.21.15.132:0/3806357334 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960037070 con 0x7fe970073bc0 2024-04-25T12:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fe96f7fe640 1 -- 172.21.15.132:0/3806357334 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe960032440 con 0x7fe970073bc0 2024-04-25T12:50:45.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fb2cd1a1640 1 -- 172.21.15.132:0/729406449 >> v1:172.21.15.157:6789/0 conn(0x7fb2c004b080 legacy=0x7fb2c00db820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fb2cd1a1640 1 -- 172.21.15.132:0/729406449 >> v1:172.21.15.132:6789/0 conn(0x7fb2c004b610 legacy=0x7fb2c0005e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fb2cd1a1640 1 -- 172.21.15.132:0/729406449 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c0046160 con 0x7fb2c000e290 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc225efb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc220159630 0x7fc22006ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc225efb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc22015f400 0x7fc22006e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc225efb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2200c8b40 0x7fc22006e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc225efb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc2201603f0 con 0x7fc2200c8b40 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc225efb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fc2200c4a50 con 0x7fc220159630 2024-04-25T12:50:45.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc225efb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc2200c45f0 con 0x7fc22015f400 2024-04-25T12:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7f2f369c8640 1 -- 172.21.15.132:0/1915545137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 msgr2=0x7f2f1c00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7f2f369c8640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f1c00b9c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c510 tx=0x7f2f1c005830 comp rx=0 tx=0).stop 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc224ef9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc220159630 0x7fc22006ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc224ef9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fc220159630 0x7fc22006ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39872/0 (socket says 172.21.15.132:39872) 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc224ef9640 1 -- 172.21.15.132:0/4221525688 learned_addr learned my addr 172.21.15.132:0/4221525688 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.943+0000 7fc2256fa640 1 --2- 172.21.15.132:0/4221525688 >> v2:172.21.15.132:3300/0 conn(0x7fc2200c8b40 0x7fc22006e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fc224ef9640 1 -- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc22015f400 msgr2=0x7fc22006e2a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fc224ef9640 1 --2- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc22015f400 0x7fc22006e2a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fc224ef9640 1 -- 172.21.15.132:0/4221525688 >> v2:172.21.15.132:3300/0 conn(0x7fc2200c8b40 msgr2=0x7fc22006e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fc224ef9640 1 --2- 172.21.15.132:0/4221525688 >> v2:172.21.15.132:3300/0 conn(0x7fc2200c8b40 0x7fc22006e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe96f7fe640 1 -- 172.21.15.132:0/3806357334 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe960032810 con 0x7fe970073bc0 2024-04-25T12:50:45.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fc224ef9640 1 -- 172.21.15.132:0/4221525688 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22015f890 con 0x7fc220159630 2024-04-25T12:50:45.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fc2256fa640 1 --2- 172.21.15.132:0/4221525688 >> v2:172.21.15.132:3300/0 conn(0x7fc2200c8b40 0x7fc22006e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:45.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7f3e42f87640 1 Processor -- start 2024-04-25T12:50:45.960 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 -- 172.21.15.132:0/3806357334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 msgr2=0x7fe9700c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 --2- 172.21.15.132:0/3806357334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 0x7fe9700c5c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fe960009870 tx=0x7fe96002a2c0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7f3e42f87640 1 -- start start 2024-04-25T12:50:45.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 -- 172.21.15.132:0/3806357334 shutdown_connections 2024-04-25T12:50:45.961 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 --2- 172.21.15.132:0/3806357334 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe970073bc0 0x7fe9700c5c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 --2- 172.21.15.132:0/3806357334 >> v2:172.21.15.132:3300/0 conn(0x7fe9700c61a0 0x7fe9700ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 -- 172.21.15.132:0/3806357334 >> 172.21.15.132:0/3806357334 conn(0x7fe970075db0 msgr2=0x7fe970067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 -- 172.21.15.132:0/3806357334 shutdown_connections 2024-04-25T12:50:45.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fe976dd8640 1 -- 172.21.15.132:0/3806357334 wait complete. 2024-04-25T12:50:45.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fc224ef9640 1 --2- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc220159630 0x7fc22006ee50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2200ca110 tx=0x7fc21402a160 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6812b7cca978799c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fb2cd1a1640 1 --2- 172.21.15.132:0/729406449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c000e290 0x7fb2c00d5160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80097a0 tx=0x7fb2b802a2e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8e2993b55e9cf055 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fc21f7fe640 1 -- 172.21.15.132:0/4221525688 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214037070 con 0x7fc220159630 2024-04-25T12:50:45.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fc21f7fe640 1 -- 172.21.15.132:0/4221525688 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc214032440 con 0x7fc220159630 2024-04-25T12:50:45.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7f2f369c8640 1 -- 172.21.15.132:0/1915545137 shutdown_connections 2024-04-25T12:50:45.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7f2f369c8640 1 --2- 172.21.15.132:0/1915545137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f1c00b9c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7f2f369c8640 1 -- 172.21.15.132:0/1915545137 >> 172.21.15.132:0/1915545137 conn(0x7f2f300cc550 msgr2=0x7f2f300cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fc21f7fe640 1 -- 172.21.15.132:0/4221525688 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc214032810 con 0x7fc220159630 2024-04-25T12:50:45.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fa8fb2c0640 1 Processor -- start 2024-04-25T12:50:45.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f3e42f87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 0x7f3e3c159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f3e42f87640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e3c0cc930 0x7f3e3c08c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f2f369c8640 1 -- 172.21.15.132:0/1915545137 shutdown_connections 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 -- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc220159630 msgr2=0x7fc22006ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 --2- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc220159630 0x7fc22006ee50 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fc2200ca110 tx=0x7fc21402a160 comp rx=0 tx=0).stop 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 -- 172.21.15.132:0/4221525688 shutdown_connections 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 --2- 172.21.15.132:0/4221525688 >> v2:172.21.15.132:3300/0 conn(0x7fc2200c8b40 0x7fc22006e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 --2- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc22015f400 0x7fc22006e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 --2- 172.21.15.132:0/4221525688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc220159630 0x7fc22006ee50 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 -- 172.21.15.132:0/4221525688 >> 172.21.15.132:0/4221525688 conn(0x7fc2200cc550 msgr2=0x7fc2200cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fb2bffff640 1 -- 172.21.15.132:0/729406449 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8037070 con 0x7fb2c000e290 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fb2bffff640 1 -- 172.21.15.132:0/729406449 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8032640 con 0x7fb2c000e290 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fb2bffff640 1 -- 172.21.15.132:0/729406449 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b80329f0 con 0x7fb2c000e290 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/729406449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c000e290 msgr2=0x7fb2c00d5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/729406449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c000e290 0x7fb2c00d5160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb2b80097a0 tx=0x7fb2b802a2e0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/729406449 shutdown_connections 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/729406449 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c000e290 0x7fb2c00d5160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/729406449 >> 172.21.15.132:0/729406449 conn(0x7fb2c0050170 msgr2=0x7fb2c0050580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:45.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/729406449 shutdown_connections 2024-04-25T12:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fe976dd8640 1 Processor -- start 2024-04-25T12:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fe976dd8640 1 -- start start 2024-04-25T12:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fe976dd8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe970073bc0 0x7fe970152380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fe976dd8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9700c61a0 0x7fe970140180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.967 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fe976dd8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe970153190 0x7fe970150e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f2f369c8640 1 -- 172.21.15.132:0/1915545137 wait complete. 2024-04-25T12:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7f2f369c8640 1 Processor -- start 2024-04-25T12:50:45.968 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fe96ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9700c61a0 0x7fe970140180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fe975375640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe970153190 0x7fe970150e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fe975375640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe970153190 0x7fe970150e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51612/0 (socket says 172.21.15.132:51612) 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fe975375640 1 -- 172.21.15.132:0/1030108698 learned_addr learned my addr 172.21.15.132:0/1030108698 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe970159d30 con 0x7fe970153190 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe970159a50 con 0x7fe970073bc0 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe9700cc580 con 0x7fe9700c61a0 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/729406449 wait complete. 2024-04-25T12:50:45.969 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fe974b74640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe970073bc0 0x7fe970152380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fb2ce1a3640 1 Processor -- start 2024-04-25T12:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fb2ce1a3640 1 -- start start 2024-04-25T12:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.944+0000 7fa8fb2c0640 1 -- start start 2024-04-25T12:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fa8fb2c0640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec04b9a0 0x7fa8ec0c6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.970 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fa8fb2c0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 0x7fa8ec0d7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fa8fb2c0640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0dce00 0x7fa8ec0d8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fa8fb2c0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec007d60 con 0x7fa8ec0db200 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fa8fb2c0640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa8ec007a80 con 0x7fa8ec04b9a0 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.945+0000 7fa8fb2c0640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa8ec04cfa0 con 0x7fa8ec0dce00 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 0x7fa8ec0d7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 0x7fa8ec0d7fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51596/0 (socket says 172.21.15.132:51596) 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 -- 172.21.15.132:0/3621276635 learned_addr learned my addr 172.21.15.132:0/3621276635 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 -- 172.21.15.132:0/3621276635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0dce00 msgr2=0x7fa8ec0d8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0dce00 0x7fa8ec0d8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 -- 172.21.15.132:0/3621276635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec04b9a0 msgr2=0x7fa8ec0c6540 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec04b9a0 0x7fa8ec0c6540 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 -- 172.21.15.132:0/3621276635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8ec0e9900 con 0x7fa8ec0db200 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fa8f9abd640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 0x7fa8ec0d7fe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c450 tx=0x7fa8e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e40052d0 con 0x7fa8ec0db200 2024-04-25T12:50:45.971 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/3621276635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8ec0d1560 con 0x7fa8ec0db200 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8e4005470 con 0x7fa8ec0db200 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8e4012870 con 0x7fa8ec0db200 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.947+0000 7fa8fb2c0640 1 -- 172.21.15.132:0/3621276635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8ec0d1b20 con 0x7fa8ec0db200 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8ec0057d0 con 0x7fa8ec0db200 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7f2f369c8640 1 -- start start 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f369c8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f3012d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.972 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f369c8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f300c3040 0x7f2f301ec230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f369c8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 0x7f2f300cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f369c8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2f300c4580 con 0x7f2f1c004160 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f369c8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2f30159a80 con 0x7f2f301eeb20 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f369c8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2f3015f400 con 0x7f2f300c3040 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f359c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f3012d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fe974b74640 1 -- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9700c61a0 msgr2=0x7fe970140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fe974b74640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9700c61a0 0x7fe970140180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fe974b74640 1 -- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe970153190 msgr2=0x7fe970150e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fe974b74640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe970153190 0x7fe970150e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.973 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fe974b74640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9700cc090 con 0x7fe970073bc0 2024-04-25T12:50:45.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f351c5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f300c3040 0x7f2f301ec230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fb2ce1a3640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 0x7fb2c0173710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 -- 172.21.15.132:0/4221525688 shutdown_connections 2024-04-25T12:50:45.974 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7fc225efb640 1 -- 172.21.15.132:0/4221525688 wait complete. 2024-04-25T12:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f361c7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 0x7f2f300cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.975 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fb2ce1a3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2c004b080 0x7fb2c00df6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fc225efb640 1 Processor -- start 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.948+0000 7fc225efb640 1 -- start start 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc225efb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2200c8b40 0x7fc220161820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc225efb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 0x7fc220071e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc225efb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22014d1d0 0x7fc220072f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc225efb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc220160110 con 0x7fc22014d1d0 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc225efb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc22015fe30 con 0x7fc2200c8b40 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc225efb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc220159a10 con 0x7fc220159630 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7fc21ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 0x7fc220071e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc2256fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22014d1d0 0x7fc220072f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 0x7fc220071e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55248/0 (socket says 172.21.15.132:55248) 2024-04-25T12:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 -- 172.21.15.132:0/792493089 learned_addr learned my addr 172.21.15.132:0/792493089 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc224ef9640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2200c8b40 0x7fc220161820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fb2cd1a1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 0x7fb2c0173710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 -- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2200c8b40 msgr2=0x7fc220161820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fb2cd1a1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 0x7fb2c0173710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55260/0 (socket says 172.21.15.132:55260) 2024-04-25T12:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2200c8b40 0x7fc220161820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 -- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22014d1d0 msgr2=0x7fc220072f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22014d1d0 0x7fc220072f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fc21ffff640 1 -- 172.21.15.132:0/792493089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc220071210 con 0x7fc220159630 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f3e3bfff640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e3c0cc930 0x7f3e3c08c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f3e40d23640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 0x7f3e3c159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.946+0000 7f3e40d23640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 0x7f3e3c159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55224/0 (socket says 172.21.15.132:55224) 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e42f87640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3c16c130 0x7f3e3c08ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e40d23640 1 -- 172.21.15.132:0/203804499 learned_addr learned my addr 172.21.15.132:0/203804499 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c168000 con 0x7f3e3c16c130 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c168ed0 con 0x7f3e3c0cc930 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3e3c169750 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f361c7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 0x7f2f300cb710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:39906/0 (socket says 172.21.15.132:39906) 2024-04-25T12:50:45.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.949+0000 7f2f361c7640 1 -- 172.21.15.132:0/2384470335 learned_addr learned my addr 172.21.15.132:0/2384470335 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f2f361c7640 1 -- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f300c3040 msgr2=0x7f2f301ec230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fb2cc9a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2c004b080 0x7fb2c00df6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fb2cd1a1640 1 -- 172.21.15.132:0/182344747 learned_addr learned my addr 172.21.15.132:0/182344747 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c004b610 0x7fb2c00ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e40d23640 1 -- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e3c0cc930 msgr2=0x7f3e3c08c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e40d23640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e3c0cc930 0x7f3e3c08c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e40d23640 1 -- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3c16c130 msgr2=0x7f3e3c08ca70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e40d23640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3c16c130 0x7f3e3c08ca70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.950+0000 7f3e40d23640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c1fe780 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f2f361c7640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f300c3040 0x7f2f301ec230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f2f361c7640 1 -- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 msgr2=0x7f2f3012d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f2f361c7640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f3012d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0046a00 con 0x7fb2c004b080 2024-04-25T12:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f2f361c7640 1 -- 172.21.15.132:0/2384470335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f301ed4a0 con 0x7f2f301eeb20 2024-04-25T12:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb2c0046720 con 0x7fb2c004b610 2024-04-25T12:50:45.982 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fc21ffff640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 0x7fc220071e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc21000b450 tx=0x7fc21000b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2cd9a2640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c004b610 0x7fb2c00ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb2c0006590 con 0x7fb2c000e290 2024-04-25T12:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fe974b74640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe970073bc0 0x7fe970152380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b410 tx=0x7fe96400b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.983 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f3e40d23640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 0x7f3e3c159650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c430 tx=0x7f3e3000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f2f351c5640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f300c3040 0x7f2f301ec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210015020 con 0x7fc220159630 2024-04-25T12:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964015020 con 0x7fe970073bc0 2024-04-25T12:50:45.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7f2f359c6640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f3012d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22014c410 con 0x7fc220159630 2024-04-25T12:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2cc9a0640 1 -- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 msgr2=0x7fb2c0173710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2cc9a0640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 0x7fb2c0173710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa8e4012a10 con 0x7fa8ec0db200 2024-04-25T12:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fa8eaffd640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa8d806c9c0 0x7fa8d806ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa8e408c650 con 0x7fa8ec0db200 2024-04-25T12:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2cc9a0640 1 -- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c004b610 msgr2=0x7fb2c00ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2cc9a0640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c004b610 0x7fb2c00ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe97013d480 con 0x7fe970073bc0 2024-04-25T12:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9701679a0 con 0x7fe970073bc0 2024-04-25T12:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe964011850 con 0x7fe970073bc0 2024-04-25T12:50:45.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fb2cc9a0640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2c00cb0d0 con 0x7fb2c004b080 2024-04-25T12:50:45.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe964011c40 con 0x7fe970073bc0 2024-04-25T12:50:45.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.951+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22014c9d0 con 0x7fc220159630 2024-04-25T12:50:45.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7fb2cd9a2640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c004b610 0x7fb2c00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7fb2cd1a1640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 0x7fb2c0173710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2100118b0 con 0x7fc220159630 2024-04-25T12:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc210011ca0 con 0x7fc220159630 2024-04-25T12:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011790 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e30017070 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e30011b90 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3c162970 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7fb2cc9a0640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2c004b080 0x7fb2c00df6f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c780 tx=0x7fb2c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3c162f30 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.952+0000 7fa8fa2be640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa8d806c9c0 0x7fa8d806ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.953+0000 7fa8fa2be640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa8d806c9c0 0x7fa8d806ee80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0034000 tx=0x7fa8f002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.953+0000 7f2f361c7640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 0x7f2f300cb710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c540 tx=0x7f2f28001ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.953+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe964018020 con 0x7fe970073bc0 2024-04-25T12:50:45.990 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe950005290 con 0x7fe970073bc0 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f28032020 con 0x7f2f301eeb20 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f28001750 con 0x7f2f301eeb20 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f301ed780 con 0x7f2f301eeb20 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f301eba30 con 0x7f2f301eeb20 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f2800c0e0 con 0x7f2f301eeb20 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7fe96d7fa640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe95c06c9c0 0x7fe95c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.991 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.954+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe96408bcf0 con 0x7fe970073bc0 2024-04-25T12:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7fe96ffff640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe95c06c9c0 0x7fe95c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc210018020 con 0x7fc220159630 2024-04-25T12:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7fc21d7fa640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc20c06c9f0 0x7fc20c06eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc21008bf30 con 0x7fc220159630 2024-04-25T12:50:45.992 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3e3001c460 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7fe96ffff640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe95c06c9c0 0x7fe95c06ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe960034000 tx=0x7fe96002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.955+0000 7f3e397fa640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3e2006c9c0 0x7f3e2006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.956+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e1c005290 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.993 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.956+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3e3008bcb0 con 0x7f3e3c0cc4e0 2024-04-25T12:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.956+0000 7fc224ef9640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc20c06c9f0 0x7fc20c06eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.956+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc200005290 con 0x7fc220159630 2024-04-25T12:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.956+0000 7fc224ef9640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc20c06c9f0 0x7fc20c06eeb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc214034000 tx=0x7fc21402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.994 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.956+0000 7f3e3bfff640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3e2006c9c0 0x7f3e2006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f18005290 con 0x7f2f301eeb20 2024-04-25T12:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c40050d0 con 0x7fb2c004b080 2024-04-25T12:50:45.995 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa8e405a690 con 0x7fa8ec0db200 2024-04-25T12:50:45.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2c00e0430 con 0x7fb2c004b080 2024-04-25T12:50:45.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2c4005270 con 0x7fb2c004b080 2024-04-25T12:50:45.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7f3e3bfff640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3e2006c9c0 0x7f3e2006ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800d440 tx=0x7f3e28008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:45.996 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c400a640 con 0x7fb2c004b080 2024-04-25T12:50:45.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.957+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2c00e09f0 con 0x7fb2c004b080 2024-04-25T12:50:45.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.958+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2c0005380 con 0x7fb2c004b080 2024-04-25T12:50:45.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.959+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe96401f020 con 0x7fe970073bc0 2024-04-25T12:50:45.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.959+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2c400a800 con 0x7fb2c004b080 2024-04-25T12:50:45.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.960+0000 7fb2bdffb640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2ac06c920 0x7fb2ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:45.997 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.960+0000 7fb2cd1a1640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2ac06c920 0x7fb2ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:45.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.960+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2f28035020 con 0x7f2f301eeb20 2024-04-25T12:50:45.998 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.961+0000 7fb2cd1a1640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2ac06c920 0x7fb2ac06ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8035040 tx=0x7fb2b802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.961+0000 7f2f267fc640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2f1406c920 0x7f2f1406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.961+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2f280ac570 con 0x7f2f301eeb20 2024-04-25T12:50:46.001 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.962+0000 7f2f359c6640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2f1406c920 0x7f2f1406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.962+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc21001f020 con 0x7fc220159630 2024-04-25T12:50:46.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.962+0000 7f2f359c6640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2f1406c920 0x7f2f1406ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009b90 tx=0x7f2f2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.002 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.963+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2c40892f0 con 0x7fb2c004b080 2024-04-25T12:50:46.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.964+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2f28079ff0 con 0x7f2f301eeb20 2024-04-25T12:50:46.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.966+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3e30059d80 con 0x7f3e3c0cc4e0 2024-04-25T12:50:46.003 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.971+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2c4059e20 con 0x7fb2c004b080 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.985+0000 7f6a23bc4640 1 Processor -- start 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.986+0000 7f6a23bc4640 1 -- start start 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a23bc4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 0x7f6a14006b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a23bc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a140db140 0x7f6a140db590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a23bc4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a14007340 con 0x7f6a140dc690 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a23bc4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6a14007620 con 0x7f6a140db140 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a23bc4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a14007900 con 0x7f6a140d53a0 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a22161640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a140db140 0x7f6a140db590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a22161640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a140db140 0x7f6a140db590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51640/0 (socket says 172.21.15.132:51640) 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.987+0000 7f6a22161640 1 -- 172.21.15.132:0/1153455714 learned_addr learned my addr 172.21.15.132:0/1153455714 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:46.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.988+0000 7f6a22161640 1 -- 172.21.15.132:0/1153455714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 msgr2=0x7f6a14006b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.988+0000 7f6a22161640 1 --2- 172.21.15.132:0/1153455714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 0x7f6a14006b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.988+0000 7f6a22161640 1 -- 172.21.15.132:0/1153455714 >> v1:172.21.15.132:6789/0 conn(0x7f6a140dc690 legacy=0x7f6a140dcab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.988+0000 7f6a22161640 1 -- 172.21.15.132:0/1153455714 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a14007be0 con 0x7f6a140db140 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.989+0000 7f6a22161640 1 --2- 172.21.15.132:0/1153455714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140db590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c07ce10 tx=0x7f6a1c0af480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea094748662c76a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.990+0000 7f6a2095e640 1 -- 172.21.15.132:0/1153455714 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0bd070 con 0x7f6a140db140 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.990+0000 7f6a2095e640 1 -- 172.21.15.132:0/1153455714 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c0b55a0 con 0x7f6a140db140 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.991+0000 7f6a23bc4640 1 -- 172.21.15.132:0/1153455714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 msgr2=0x7f6a140db590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.991+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/1153455714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140db590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c07ce10 tx=0x7f6a1c0af480 comp rx=0 tx=0).stop 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.991+0000 7f6a23bc4640 1 -- 172.21.15.132:0/1153455714 shutdown_connections 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.991+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/1153455714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140db590 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.991+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/1153455714 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 0x7f6a14006b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.991+0000 7f6a23bc4640 1 -- 172.21.15.132:0/1153455714 >> 172.21.15.132:0/1153455714 conn(0x7f6a14050a00 msgr2=0x7f6a14050e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.992+0000 7f6a23bc4640 1 -- 172.21.15.132:0/1153455714 shutdown_connections 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.992+0000 7f6a23bc4640 1 -- 172.21.15.132:0/1153455714 wait complete. 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.994+0000 7f6a23bc4640 1 Processor -- start 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.994+0000 7f6a23bc4640 1 -- start start 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.995+0000 7f6a23bc4640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 0x7f6a140ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.995+0000 7f6a23bc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140ddfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.995+0000 7f6a23bc4640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a140dc690 0x7f6a14170a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a23bc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6a14007040 con 0x7f6a140db140 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a23bc4640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6a140081a0 con 0x7f6a140dc690 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a2115f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140ddfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a23bc4640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a1404d1f0 con 0x7f6a140d53a0 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a2115f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140ddfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51642/0 (socket says 172.21.15.132:51642) 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a2115f640 1 -- 172.21.15.132:0/3562818779 learned_addr learned my addr 172.21.15.132:0/3562818779 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:46.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a22161640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a140dc690 0x7f6a14170a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a22161640 1 -- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 msgr2=0x7f6a140ccb60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a22161640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 0x7f6a140ccb60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a22161640 1 -- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 msgr2=0x7f6a140ddfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a22161640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140ddfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.996+0000 7f6a22161640 1 -- 172.21.15.132:0/3562818779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a140ca930 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.997+0000 7f6a22161640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a140dc690 0x7f6a14170a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c07cc00 tx=0x7f6a1c06acd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.997+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0c7070 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.997+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a14174640 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.997+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a140c9f80 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.997+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a1c0b8c10 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:45.998+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c0bd040 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.000+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a1c0c0070 con 0x7f6a140dc690 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.001+0000 7f6a127fc640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a0006c9c0 0x7f6a0006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.011 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.001+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6a1c131a60 con 0x7f6a140dc690 2024-04-25T12:50:46.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.001+0000 7f6a21960640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a0006c9c0 0x7f6a0006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.002+0000 7f6a21960640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a0006c9c0 0x7f6a0006ee80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009670 tx=0x7f6a0c006bd0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.002+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a140057d0 con 0x7f6a140dc690 2024-04-25T12:50:46.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.008+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a1c0ff600 con 0x7f6a140dc690 2024-04-25T12:50:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.310+0000 7f7b6474f640 1 -- 172.21.15.132:0/3022211987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7b44005580 con 0x7f7b5c0cc600 2024-04-25T12:50:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.311+0000 7f7b52ffd640 1 -- 172.21.15.132:0/3022211987 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b54062f80 con 0x7f7b5c0cc600 2024-04-25T12:50:46.310 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.315+0000 7f7b50ff9640 1 -- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b4006ca20 msgr2=0x7f7b4006eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.315+0000 7f7b50ff9640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b4006ca20 0x7f7b4006eee0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7b58000f60 tx=0x7f7b58000ed0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.315+0000 7f7b50ff9640 1 -- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 msgr2=0x7f7b5c153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.315+0000 7f7b50ff9640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 0x7f7b5c153e70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400a430 tx=0x7f7b5400a8f0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 -- 172.21.15.132:0/3022211987 shutdown_connections 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7b4006ca20 0x7f7b4006eee0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7b5c1579f0 0x7f7b5c156530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b5c0cc600 0x7f7b5c153e70 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 --2- 172.21.15.132:0/3022211987 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7b5c0c4030 0x7f7b5c150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 -- 172.21.15.132:0/3022211987 >> 172.21.15.132:0/3022211987 conn(0x7f7b5c075db0 msgr2=0x7f7b5c06e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 -- 172.21.15.132:0/3022211987 shutdown_connections 2024-04-25T12:50:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.316+0000 7f7b50ff9640 1 -- 172.21.15.132:0/3022211987 wait complete. 2024-04-25T12:50:46.331 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-25T12:50:46.331 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.357+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3e1c005580 con 0x7f3e3c0cc4e0 2024-04-25T12:50:46.355 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.357+0000 7f3e397fa640 1 -- 172.21.15.132:0/203804499 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e30059680 con 0x7f3e3c0cc4e0 2024-04-25T12:50:46.355 INFO:teuthology.orchestra.run.smithi132.stdout:60129542155 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3e2006c9c0 msgr2=0x7f3e2006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3e2006c9c0 0x7f3e2006ee80 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800d440 tx=0x7f3e28008040 comp rx=0 tx=0).stop 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 msgr2=0x7f3e3c159650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 0x7f3e3c159650 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3e3000c430 tx=0x7f3e3000c8f0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 shutdown_connections 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3e2006c9c0 0x7f3e2006ee80 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3c16c130 0x7f3e3c08ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3e3c0cc930 0x7f3e3c08c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 --2- 172.21.15.132:0/203804499 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3e3c0cc4e0 0x7f3e3c159650 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 >> 172.21.15.132:0/203804499 conn(0x7f3e3c075db0 msgr2=0x7f3e3c0c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 shutdown_connections 2024-04-25T12:50:46.359 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.360+0000 7f3e42f87640 1 -- 172.21.15.132:0/203804499 wait complete. 2024-04-25T12:50:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.370+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2f18005850 con 0x7f2f301eeb20 2024-04-25T12:50:46.369 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.371+0000 7f2f267fc640 1 -- 172.21.15.132:0/2384470335 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2f2807e2f0 con 0x7f2f301eeb20 2024-04-25T12:50:46.369 INFO:teuthology.orchestra.run.smithi132.stdout:55834574860 2024-04-25T12:50:46.370 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.1 2024-04-25T12:50:46.370 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2f1406c920 msgr2=0x7f2f1406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2f1406c920 0x7f2f1406ede0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c009b90 tx=0x7f2f2c008040 comp rx=0 tx=0).stop 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 msgr2=0x7f2f300cb710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 0x7f2f300cb710 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f2f2800c540 tx=0x7f2f28001ca0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 shutdown_connections 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2f1406c920 0x7f2f1406ede0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2f301eeb20 0x7f2f300cb710 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2f300c3040 0x7f2f301ec230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.373 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 --2- 172.21.15.132:0/2384470335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f1c004160 0x7f2f3012d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 >> 172.21.15.132:0/2384470335 conn(0x7f2f300cc550 msgr2=0x7f2f3006e340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 shutdown_connections 2024-04-25T12:50:46.374 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.374+0000 7f2f369c8640 1 -- 172.21.15.132:0/2384470335 wait complete. 2024-04-25T12:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.382+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fa8ec0d4990 con 0x7fa8ec0db200 2024-04-25T12:50:46.380 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.382+0000 7fa8eaffd640 1 -- 172.21.15.132:0/3621276635 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8e4059f90 con 0x7fa8ec0db200 2024-04-25T12:50:46.380 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:46.381 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.384+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe950005580 con 0x7fe970073bc0 2024-04-25T12:50:46.382 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.384+0000 7fe96d7fa640 1 -- 172.21.15.132:0/1030108698 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe964059e00 con 0x7fe970073bc0 2024-04-25T12:50:46.382 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.385+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa8d806c9c0 msgr2=0x7fa8d806ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.385+0000 7fa8e8ff9640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa8d806c9c0 0x7fa8d806ee80 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa8f0034000 tx=0x7fa8f002e000 comp rx=0 tx=0).stop 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.385+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 msgr2=0x7fa8ec0d7fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.385+0000 7fa8e8ff9640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 0x7fa8ec0d7fe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fa8e400c450 tx=0x7fa8e400c910 comp rx=0 tx=0).stop 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 shutdown_connections 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa8d806c9c0 0x7fa8d806ee80 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa8ec0dce00 0x7fa8ec0d8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8ec0db200 0x7fa8ec0d7fe0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 --2- 172.21.15.132:0/3621276635 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa8ec04b9a0 0x7fa8ec0c6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 >> 172.21.15.132:0/3621276635 conn(0x7fa8ec04d4a0 msgr2=0x7fa8ec04d880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.384 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 shutdown_connections 2024-04-25T12:50:46.385 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.386+0000 7fa8e8ff9640 1 -- 172.21.15.132:0/3621276635 wait complete. 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe95c06c9c0 msgr2=0x7fe95c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe95c06c9c0 0x7fe95c06ee80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fe960034000 tx=0x7fe96002e000 comp rx=0 tx=0).stop 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe970073bc0 msgr2=0x7fe970152380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe970073bc0 0x7fe970152380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe96400b410 tx=0x7fe96400b8d0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 shutdown_connections 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe95c06c9c0 0x7fe95c06ee80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe970153190 0x7fe970150e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe9700c61a0 0x7fe970140180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.387 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 --2- 172.21.15.132:0/1030108698 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe970073bc0 0x7fe970152380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 >> 172.21.15.132:0/1030108698 conn(0x7fe970075db0 msgr2=0x7fe9700ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 shutdown_connections 2024-04-25T12:50:46.388 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.388+0000 7fe976dd8640 1 -- 172.21.15.132:0/1030108698 wait complete. 2024-04-25T12:50:46.389 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.6 2024-04-25T12:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.390+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fc200005580 con 0x7fc220159630 2024-04-25T12:50:46.389 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.391+0000 7fc21d7fa640 1 -- 172.21.15.132:0/792493089 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc21000d040 con 0x7fc220159630 2024-04-25T12:50:46.389 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.389 INFO:teuthology.orchestra.run.smithi132.stdout:55834574858 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.394+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc20c06c9f0 msgr2=0x7fc20c06eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.394+0000 7fc225efb640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc20c06c9f0 0x7fc20c06eeb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fc214034000 tx=0x7fc21402e000 comp rx=0 tx=0).stop 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.394+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 msgr2=0x7fc220071e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.394+0000 7fc225efb640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 0x7fc220071e00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc21000b450 tx=0x7fc21000b910 comp rx=0 tx=0).stop 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 shutdown_connections 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc20c06c9f0 0x7fc20c06eeb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc22014d1d0 0x7fc220072f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc220159630 0x7fc220071e00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 --2- 172.21.15.132:0/792493089 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc2200c8b40 0x7fc220161820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 >> 172.21.15.132:0/792493089 conn(0x7fc2200cc550 msgr2=0x7fc2200c77d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 shutdown_connections 2024-04-25T12:50:46.394 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.395+0000 7fc225efb640 1 -- 172.21.15.132:0/792493089 wait complete. 2024-04-25T12:50:46.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.397+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb2c00d48d0 con 0x7fb2c004b080 2024-04-25T12:50:46.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.398+0000 7fb2bdffb640 1 -- 172.21.15.132:0/182344747 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2c4059e20 con 0x7fb2c004b080 2024-04-25T12:50:46.396 INFO:teuthology.orchestra.run.smithi132.stdout:60129542156 2024-04-25T12:50:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2ac06c920 msgr2=0x7fb2ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2ac06c920 0x7fb2ac06ede0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8035040 tx=0x7fb2b802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2c004b080 msgr2=0x7fb2c00df6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2c004b080 0x7fb2c00df6f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c780 tx=0x7fb2c400cc40 comp rx=0 tx=0).stop 2024-04-25T12:50:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 shutdown_connections 2024-04-25T12:50:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2ac06c920 0x7fb2ac06ede0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2c004b610 0x7fb2c00ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2c004b080 0x7fb2c00df6f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 --2- 172.21.15.132:0/182344747 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2c000e290 0x7fb2c0173710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 >> 172.21.15.132:0/182344747 conn(0x7fb2c0050170 msgr2=0x7fb2c00d37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 shutdown_connections 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.401+0000 7fb2ce1a3640 1 -- 172.21.15.132:0/182344747 wait complete. 2024-04-25T12:50:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.402+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6a140d4bc0 con 0x7f6a140dc690 2024-04-25T12:50:46.401 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-25T12:50:46.401 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.403+0000 7f6a127fc640 1 -- 172.21.15.132:0/3562818779 <== mon.1 v2:172.21.15.157:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6a1c103900 con 0x7f6a140dc690 2024-04-25T12:50:46.402 INFO:teuthology.orchestra.run.smithi132.stdout:55834574859 2024-04-25T12:50:46.402 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.403 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.4 2024-04-25T12:50:46.404 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a0006c9c0 msgr2=0x7f6a0006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a0006c9c0 0x7f6a0006ee80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c009670 tx=0x7f6a0c006bd0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a140dc690 msgr2=0x7f6a14170a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a140dc690 0x7f6a14170a00 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c07cc00 tx=0x7f6a1c06acd0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 shutdown_connections 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a0006c9c0 0x7f6a0006ee80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a140dc690 0x7f6a14170a00 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a140db140 0x7f6a140ddfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.404 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 --2- 172.21.15.132:0/3562818779 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a140d53a0 0x7f6a140ccb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 >> 172.21.15.132:0/3562818779 conn(0x7f6a14050a00 msgr2=0x7f6a140059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.405+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 shutdown_connections 2024-04-25T12:50:46.405 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.406+0000 7f6a23bc4640 1 -- 172.21.15.132:0/3562818779 wait complete. 2024-04-25T12:50:46.410 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.7 2024-04-25T12:50:46.410 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.413 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542156 got 60129542156 for osd.0 2024-04-25T12:50:46.413 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.415 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.2 2024-04-25T12:50:46.416 DEBUG:teuthology.parallel:result is None 2024-04-25T12:50:46.416 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T12:50:46.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:46.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.554+0000 7f7ae4122640 1 Processor -- start 2024-04-25T12:50:46.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae4122640 1 -- start start 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae4122640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7adc1557e0 0x7f7adc0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae4122640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7adc0cbf70 0x7f7adc06d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae4122640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7adc0cc400 con 0x7f7adc0cc730 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae4122640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7adc0cb5a0 con 0x7f7adc1557e0 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae4122640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7adc15ed80 con 0x7f7adc0cbf70 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.555+0000 7f7ae1ebe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7adc1557e0 0x7f7adc0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7adc1557e0 0x7f7adc0cba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51654/0 (socket says 172.21.15.132:51654) 2024-04-25T12:50:46.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 -- 172.21.15.132:0/40073352 learned_addr learned my addr 172.21.15.132:0/40073352 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 -- 172.21.15.132:0/40073352 >> v2:172.21.15.157:3300/0 conn(0x7f7adc0cbf70 msgr2=0x7f7adc06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 --2- 172.21.15.132:0/40073352 >> v2:172.21.15.157:3300/0 conn(0x7f7adc0cbf70 0x7f7adc06d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 -- 172.21.15.132:0/40073352 >> v1:172.21.15.157:6789/0 conn(0x7f7adc0cc730 legacy=0x7f7adc06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:46.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 -- 172.21.15.132:0/40073352 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc15f060 con 0x7f7adc1557e0 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.556+0000 7f7ae1ebe640 1 --2- 172.21.15.132:0/40073352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc0cba30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0c7c70 tx=0x7f7ad802a230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21f41084b50139ed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae0ebc640 1 -- 172.21.15.132:0/40073352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8037070 con 0x7f7adc1557e0 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae0ebc640 1 -- 172.21.15.132:0/40073352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad8032440 con 0x7f7adc1557e0 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae0ebc640 1 -- 172.21.15.132:0/40073352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad8032810 con 0x7f7adc1557e0 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 -- 172.21.15.132:0/40073352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 msgr2=0x7f7adc0cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 --2- 172.21.15.132:0/40073352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc0cba30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0c7c70 tx=0x7f7ad802a230 comp rx=0 tx=0).stop 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 -- 172.21.15.132:0/40073352 shutdown_connections 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 --2- 172.21.15.132:0/40073352 >> v2:172.21.15.157:3300/0 conn(0x7f7adc0cbf70 0x7f7adc06d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 --2- 172.21.15.132:0/40073352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc0cba30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 -- 172.21.15.132:0/40073352 >> 172.21.15.132:0/40073352 conn(0x7f7adc0d0e10 msgr2=0x7f7adc0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 -- 172.21.15.132:0/40073352 shutdown_connections 2024-04-25T12:50:46.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.557+0000 7f7ae4122640 1 -- 172.21.15.132:0/40073352 wait complete. 2024-04-25T12:50:46.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.558+0000 7f7ae4122640 1 Processor -- start 2024-04-25T12:50:46.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.558+0000 7f7ae4122640 1 -- start start 2024-04-25T12:50:46.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae4122640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7adc0cbf70 0x7f7adc1f3450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae4122640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7adc0cc730 0x7f7adc14da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae4122640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae4122640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc06d610 con 0x7f7adc1557e0 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae4122640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc15f620 con 0x7f7adc0cc730 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae4122640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7adc0cd0c0 con 0x7f7adc0cbf70 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc14dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51662/0 (socket says 172.21.15.132:51662) 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 -- 172.21.15.132:0/1155742064 learned_addr learned my addr 172.21.15.132:0/1155742064 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae16bd640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7adc0cc730 0x7f7adc14da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae1ebe640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7adc0cbf70 0x7f7adc1f3450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 -- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7adc0cbf70 msgr2=0x7f7adc1f3450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7adc0cbf70 0x7f7adc1f3450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 -- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7adc0cc730 msgr2=0x7f7adc14da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7adc0cc730 0x7f7adc14da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae26bf640 1 -- 172.21.15.132:0/1155742064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc1565d0 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.559+0000 7f7ae16bd640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7adc0cc730 0x7f7adc14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.560+0000 7f7ae26bf640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc14dfd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b9a0 tx=0x7f7ad400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.560+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4019070 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.560+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad400cbc0 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.560+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc155dc0 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.560+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4014440 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.560+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1f2970 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.561+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc1f2760 con 0x7f7adc1557e0 2024-04-25T12:50:46.561 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.561+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7ad401c070 con 0x7f7adc1557e0 2024-04-25T12:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.562+0000 7f7ad27fc640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7ac006c8f0 0x7f7ac006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.562+0000 7f7ae1ebe640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7ac006c8f0 0x7f7ac006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.562+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7ad408bc90 con 0x7f7adc1557e0 2024-04-25T12:50:46.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.562+0000 7f7ae1ebe640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7ac006c8f0 0x7f7ac006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8034000 tx=0x7f7ad802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.566+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7ad4059cf0 con 0x7f7adc1557e0 2024-04-25T12:50:46.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.739+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7adc068c20 con 0x7f7ac006c8f0 2024-04-25T12:50:46.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.746+0000 7f7ad27fc640 1 -- 172.21.15.132:0/1155742064 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7f7adc068c20 con 0x7f7ac006c8f0 2024-04-25T12:50:46.748 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:46.750 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:46.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7ac006c8f0 msgr2=0x7f7ac006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7ac006c8f0 0x7f7ac006edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7ad8034000 tx=0x7f7ad802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 msgr2=0x7f7adc14dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc14dfd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f7ad400b9a0 tx=0x7f7ad400be60 comp rx=0 tx=0).stop 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 shutdown_connections 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7ac006c8f0 0x7f7ac006edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc1557e0 0x7f7adc14dfd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7adc0cc730 0x7f7adc14da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 --2- 172.21.15.132:0/1155742064 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7adc0cbf70 0x7f7adc1f3450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 >> 172.21.15.132:0/1155742064 conn(0x7f7adc0d0e10 msgr2=0x7f7adc153480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 shutdown_connections 2024-04-25T12:50:46.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.750+0000 7f7ae4122640 1 -- 172.21.15.132:0/1155742064 wait complete. 2024-04-25T12:50:46.759 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T12:50:45.134160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231920,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742800,"statfs":{"total":773094113280,"available":772856627200,"internally_reserved":0,"allocated":3350528,"data_stored":2024952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490836+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:18.490836+0000","last_peered":"2024-04-25T12:50:18.490836+0000","last_clean":"2024-04-25T12:50:18.490836+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:18.490836+0000","last_undegraded":"2024-04-25T12:50:18.490836+0000","last_fullsized":"2024-04-25T12:50:18.490836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376123+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:18.376123+0000","last_peered":"2024-04-25T12:50:18.376123+0000","last_clean":"2024-04-25T12:50:18.376123+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:18.376123+0000","last_undegraded":"2024-04-25T12:50:18.376123+0000","last_fullsized":"2024-04-25T12:50:18.376123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375559+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:18.375559+0000","last_peered":"2024-04-25T12:50:18.375559+0000","last_clean":"2024-04-25T12:50:18.375559+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:18.375559+0000","last_undegraded":"2024-04-25T12:50:18.375559+0000","last_fullsized":"2024-04-25T12:50:18.375559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376235+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:18.376235+0000","last_peered":"2024-04-25T12:50:18.376235+0000","last_clean":"2024-04-25T12:50:18.376235+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:18.376235+0000","last_undegraded":"2024-04-25T12:50:18.376235+0000","last_fullsized":"2024-04-25T12:50:18.376235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490678+0000","last_change":"2024-04-25T12:50:13.364716+0000","last_active":"2024-04-25T12:50:18.490678+0000","last_peered":"2024-04-25T12:50:18.490678+0000","last_clean":"2024-04-25T12:50:18.490678+0000","last_became_active":"2024-04-25T12:50:13.364220+0000","last_became_peered":"2024-04-25T12:50:13.364220+0000","last_unstale":"2024-04-25T12:50:18.490678+0000","last_undegraded":"2024-04-25T12:50:18.490678+0000","last_fullsized":"2024-04-25T12:50:18.490678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:04.451868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373674+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:18.373674+0000","last_peered":"2024-04-25T12:50:18.373674+0000","last_clean":"2024-04-25T12:50:18.373674+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:18.373674+0000","last_undegraded":"2024-04-25T12:50:18.373674+0000","last_fullsized":"2024-04-25T12:50:18.373674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194164+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:19.194164+0000","last_peered":"2024-04-25T12:50:19.194164+0000","last_clean":"2024-04-25T12:50:19.194164+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:19.194164+0000","last_undegraded":"2024-04-25T12:50:19.194164+0000","last_fullsized":"2024-04-25T12:50:19.194164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194639+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:19.194639+0000","last_peered":"2024-04-25T12:50:19.194639+0000","last_clean":"2024-04-25T12:50:19.194639+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:19.194639+0000","last_undegraded":"2024-04-25T12:50:19.194639+0000","last_fullsized":"2024-04-25T12:50:19.194639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373856+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:18.373856+0000","last_peered":"2024-04-25T12:50:18.373856+0000","last_clean":"2024-04-25T12:50:18.373856+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:18.373856+0000","last_undegraded":"2024-04-25T12:50:18.373856+0000","last_fullsized":"2024-04-25T12:50:18.373856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193649+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:19.193649+0000","last_peered":"2024-04-25T12:50:19.193649+0000","last_clean":"2024-04-25T12:50:19.193649+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:19.193649+0000","last_undegraded":"2024-04-25T12:50:19.193649+0000","last_fullsized":"2024-04-25T12:50:19.193649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194115+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:19.194115+0000","last_peered":"2024-04-25T12:50:19.194115+0000","last_clean":"2024-04-25T12:50:19.194115+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:19.194115+0000","last_undegraded":"2024-04-25T12:50:19.194115+0000","last_fullsized":"2024-04-25T12:50:19.194115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373780+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:18.373780+0000","last_peered":"2024-04-25T12:50:18.373780+0000","last_clean":"2024-04-25T12:50:18.373780+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:18.373780+0000","last_undegraded":"2024-04-25T12:50:18.373780+0000","last_fullsized":"2024-04-25T12:50:18.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707963+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:18.707963+0000","last_peered":"2024-04-25T12:50:18.707963+0000","last_clean":"2024-04-25T12:50:18.707963+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:18.707963+0000","last_undegraded":"2024-04-25T12:50:18.707963+0000","last_fullsized":"2024-04-25T12:50:18.707963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194274+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:19.194274+0000","last_peered":"2024-04-25T12:50:19.194274+0000","last_clean":"2024-04-25T12:50:19.194274+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:19.194274+0000","last_undegraded":"2024-04-25T12:50:19.194274+0000","last_fullsized":"2024-04-25T12:50:19.194274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374554+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:18.374554+0000","last_peered":"2024-04-25T12:50:18.374554+0000","last_clean":"2024-04-25T12:50:18.374554+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:18.374554+0000","last_undegraded":"2024-04-25T12:50:18.374554+0000","last_fullsized":"2024-04-25T12:50:18.374554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375774+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:18.375774+0000","last_peered":"2024-04-25T12:50:18.375774+0000","last_clean":"2024-04-25T12:50:18.375774+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:18.375774+0000","last_undegraded":"2024-04-25T12:50:18.375774+0000","last_fullsized":"2024-04-25T12:50:18.375774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443390+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:18.443390+0000","last_peered":"2024-04-25T12:50:18.443390+0000","last_clean":"2024-04-25T12:50:18.443390+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:18.443390+0000","last_undegraded":"2024-04-25T12:50:18.443390+0000","last_fullsized":"2024-04-25T12:50:18.443390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374576+0000","last_change":"2024-04-25T12:50:17.391816+0000","last_active":"2024-04-25T12:50:18.374576+0000","last_peered":"2024-04-25T12:50:18.374576+0000","last_clean":"2024-04-25T12:50:18.374576+0000","last_became_active":"2024-04-25T12:50:17.390690+0000","last_became_peered":"2024-04-25T12:50:17.390690+0000","last_unstale":"2024-04-25T12:50:18.374576+0000","last_undegraded":"2024-04-25T12:50:18.374576+0000","last_fullsized":"2024-04-25T12:50:18.374576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:25.879819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375734+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:18.375734+0000","last_peered":"2024-04-25T12:50:18.375734+0000","last_clean":"2024-04-25T12:50:18.375734+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:18.375734+0000","last_undegraded":"2024-04-25T12:50:18.375734+0000","last_fullsized":"2024-04-25T12:50:18.375734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443166+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:18.443166+0000","last_peered":"2024-04-25T12:50:18.443166+0000","last_clean":"2024-04-25T12:50:18.443166+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:18.443166+0000","last_undegraded":"2024-04-25T12:50:18.443166+0000","last_fullsized":"2024-04-25T12:50:18.443166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443959+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:18.443959+0000","last_peered":"2024-04-25T12:50:18.443959+0000","last_clean":"2024-04-25T12:50:18.443959+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:18.443959+0000","last_undegraded":"2024-04-25T12:50:18.443959+0000","last_fullsized":"2024-04-25T12:50:18.443959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373924+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:18.373924+0000","last_peered":"2024-04-25T12:50:18.373924+0000","last_clean":"2024-04-25T12:50:18.373924+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:18.373924+0000","last_undegraded":"2024-04-25T12:50:18.373924+0000","last_fullsized":"2024-04-25T12:50:18.373924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193144+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:19.193144+0000","last_peered":"2024-04-25T12:50:19.193144+0000","last_clean":"2024-04-25T12:50:19.193144+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:19.193144+0000","last_undegraded":"2024-04-25T12:50:19.193144+0000","last_fullsized":"2024-04-25T12:50:19.193144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374315+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:18.374315+0000","last_peered":"2024-04-25T12:50:18.374315+0000","last_clean":"2024-04-25T12:50:18.374315+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:18.374315+0000","last_undegraded":"2024-04-25T12:50:18.374315+0000","last_fullsized":"2024-04-25T12:50:18.374315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491033+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:18.491033+0000","last_peered":"2024-04-25T12:50:18.491033+0000","last_clean":"2024-04-25T12:50:18.491033+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:18.491033+0000","last_undegraded":"2024-04-25T12:50:18.491033+0000","last_fullsized":"2024-04-25T12:50:18.491033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708733+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:18.708733+0000","last_peered":"2024-04-25T12:50:18.708733+0000","last_clean":"2024-04-25T12:50:18.708733+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:18.708733+0000","last_undegraded":"2024-04-25T12:50:18.708733+0000","last_fullsized":"2024-04-25T12:50:18.708733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373854+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:18.373854+0000","last_peered":"2024-04-25T12:50:18.373854+0000","last_clean":"2024-04-25T12:50:18.373854+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:18.373854+0000","last_undegraded":"2024-04-25T12:50:18.373854+0000","last_fullsized":"2024-04-25T12:50:18.373854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376351+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:18.376351+0000","last_peered":"2024-04-25T12:50:18.376351+0000","last_clean":"2024-04-25T12:50:18.376351+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:18.376351+0000","last_undegraded":"2024-04-25T12:50:18.376351+0000","last_fullsized":"2024-04-25T12:50:18.376351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443909+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:18.443909+0000","last_peered":"2024-04-25T12:50:18.443909+0000","last_clean":"2024-04-25T12:50:18.443909+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:18.443909+0000","last_undegraded":"2024-04-25T12:50:18.443909+0000","last_fullsized":"2024-04-25T12:50:18.443909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375492+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:18.375492+0000","last_peered":"2024-04-25T12:50:18.375492+0000","last_clean":"2024-04-25T12:50:18.375492+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:18.375492+0000","last_undegraded":"2024-04-25T12:50:18.375492+0000","last_fullsized":"2024-04-25T12:50:18.375492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443634+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:18.443634+0000","last_peered":"2024-04-25T12:50:18.443634+0000","last_clean":"2024-04-25T12:50:18.443634+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:18.443634+0000","last_undegraded":"2024-04-25T12:50:18.443634+0000","last_fullsized":"2024-04-25T12:50:18.443634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194390+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:19.194390+0000","last_peered":"2024-04-25T12:50:19.194390+0000","last_clean":"2024-04-25T12:50:19.194390+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:19.194390+0000","last_undegraded":"2024-04-25T12:50:19.194390+0000","last_fullsized":"2024-04-25T12:50:19.194390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490617+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:18.490617+0000","last_peered":"2024-04-25T12:50:18.490617+0000","last_clean":"2024-04-25T12:50:18.490617+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:18.490617+0000","last_undegraded":"2024-04-25T12:50:18.490617+0000","last_fullsized":"2024-04-25T12:50:18.490617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194216+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:19.194216+0000","last_peered":"2024-04-25T12:50:19.194216+0000","last_clean":"2024-04-25T12:50:19.194216+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:19.194216+0000","last_undegraded":"2024-04-25T12:50:19.194216+0000","last_fullsized":"2024-04-25T12:50:19.194216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443733+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:18.443733+0000","last_peered":"2024-04-25T12:50:18.443733+0000","last_clean":"2024-04-25T12:50:18.443733+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:18.443733+0000","last_undegraded":"2024-04-25T12:50:18.443733+0000","last_fullsized":"2024-04-25T12:50:18.443733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443260+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:18.443260+0000","last_peered":"2024-04-25T12:50:18.443260+0000","last_clean":"2024-04-25T12:50:18.443260+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:18.443260+0000","last_undegraded":"2024-04-25T12:50:18.443260+0000","last_fullsized":"2024-04-25T12:50:18.443260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374282+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:18.374282+0000","last_peered":"2024-04-25T12:50:18.374282+0000","last_clean":"2024-04-25T12:50:18.374282+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:18.374282+0000","last_undegraded":"2024-04-25T12:50:18.374282+0000","last_fullsized":"2024-04-25T12:50:18.374282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193689+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:19.193689+0000","last_peered":"2024-04-25T12:50:19.193689+0000","last_clean":"2024-04-25T12:50:19.193689+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:19.193689+0000","last_undegraded":"2024-04-25T12:50:19.193689+0000","last_fullsized":"2024-04-25T12:50:19.193689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443658+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:18.443658+0000","last_peered":"2024-04-25T12:50:18.443658+0000","last_clean":"2024-04-25T12:50:18.443658+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:18.443658+0000","last_undegraded":"2024-04-25T12:50:18.443658+0000","last_fullsized":"2024-04-25T12:50:18.443658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443155+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:18.443155+0000","last_peered":"2024-04-25T12:50:18.443155+0000","last_clean":"2024-04-25T12:50:18.443155+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:18.443155+0000","last_undegraded":"2024-04-25T12:50:18.443155+0000","last_fullsized":"2024-04-25T12:50:18.443155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193161+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:19.193161+0000","last_peered":"2024-04-25T12:50:19.193161+0000","last_clean":"2024-04-25T12:50:19.193161+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:19.193161+0000","last_undegraded":"2024-04-25T12:50:19.193161+0000","last_fullsized":"2024-04-25T12:50:19.193161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443997+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:18.443997+0000","last_peered":"2024-04-25T12:50:18.443997+0000","last_clean":"2024-04-25T12:50:18.443997+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:18.443997+0000","last_undegraded":"2024-04-25T12:50:18.443997+0000","last_fullsized":"2024-04-25T12:50:18.443997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490428+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:18.490428+0000","last_peered":"2024-04-25T12:50:18.490428+0000","last_clean":"2024-04-25T12:50:18.490428+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:18.490428+0000","last_undegraded":"2024-04-25T12:50:18.490428+0000","last_fullsized":"2024-04-25T12:50:18.490428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193145+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:19.193145+0000","last_peered":"2024-04-25T12:50:19.193145+0000","last_clean":"2024-04-25T12:50:19.193145+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:19.193145+0000","last_undegraded":"2024-04-25T12:50:19.193145+0000","last_fullsized":"2024-04-25T12:50:19.193145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491068+0000","last_change":"2024-04-25T12:50:17.401693+0000","last_active":"2024-04-25T12:50:18.491068+0000","last_peered":"2024-04-25T12:50:18.491068+0000","last_clean":"2024-04-25T12:50:18.491068+0000","last_became_active":"2024-04-25T12:50:17.401301+0000","last_became_peered":"2024-04-25T12:50:17.401301+0000","last_unstale":"2024-04-25T12:50:18.491068+0000","last_undegraded":"2024-04-25T12:50:18.491068+0000","last_fullsized":"2024-04-25T12:50:18.491068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:18.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375470+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:18.375470+0000","last_peered":"2024-04-25T12:50:18.375470+0000","last_clean":"2024-04-25T12:50:18.375470+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:18.375470+0000","last_undegraded":"2024-04-25T12:50:18.375470+0000","last_fullsized":"2024-04-25T12:50:18.375470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193598+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:19.193598+0000","last_peered":"2024-04-25T12:50:19.193598+0000","last_clean":"2024-04-25T12:50:19.193598+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:19.193598+0000","last_undegraded":"2024-04-25T12:50:19.193598+0000","last_fullsized":"2024-04-25T12:50:19.193598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193275+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:19.193275+0000","last_peered":"2024-04-25T12:50:19.193275+0000","last_clean":"2024-04-25T12:50:19.193275+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:19.193275+0000","last_undegraded":"2024-04-25T12:50:19.193275+0000","last_fullsized":"2024-04-25T12:50:19.193275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708408+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:18.708408+0000","last_peered":"2024-04-25T12:50:18.708408+0000","last_clean":"2024-04-25T12:50:18.708408+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:18.708408+0000","last_undegraded":"2024-04-25T12:50:18.708408+0000","last_fullsized":"2024-04-25T12:50:18.708408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193953+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:19.193953+0000","last_peered":"2024-04-25T12:50:19.193953+0000","last_clean":"2024-04-25T12:50:19.193953+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:19.193953+0000","last_undegraded":"2024-04-25T12:50:19.193953+0000","last_fullsized":"2024-04-25T12:50:19.193953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193281+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:19.193281+0000","last_peered":"2024-04-25T12:50:19.193281+0000","last_clean":"2024-04-25T12:50:19.193281+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:19.193281+0000","last_undegraded":"2024-04-25T12:50:19.193281+0000","last_fullsized":"2024-04-25T12:50:19.193281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708109+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:18.708109+0000","last_peered":"2024-04-25T12:50:18.708109+0000","last_clean":"2024-04-25T12:50:18.708109+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:18.708109+0000","last_undegraded":"2024-04-25T12:50:18.708109+0000","last_fullsized":"2024-04-25T12:50:18.708109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194752+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:19.194752+0000","last_peered":"2024-04-25T12:50:19.194752+0000","last_clean":"2024-04-25T12:50:19.194752+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:19.194752+0000","last_undegraded":"2024-04-25T12:50:19.194752+0000","last_fullsized":"2024-04-25T12:50:19.194752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443731+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:18.443731+0000","last_peered":"2024-04-25T12:50:18.443731+0000","last_clean":"2024-04-25T12:50:18.443731+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:18.443731+0000","last_undegraded":"2024-04-25T12:50:18.443731+0000","last_fullsized":"2024-04-25T12:50:18.443731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490742+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:18.490742+0000","last_peered":"2024-04-25T12:50:18.490742+0000","last_clean":"2024-04-25T12:50:18.490742+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:18.490742+0000","last_undegraded":"2024-04-25T12:50:18.490742+0000","last_fullsized":"2024-04-25T12:50:18.490742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194447+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:19.194447+0000","last_peered":"2024-04-25T12:50:19.194447+0000","last_clean":"2024-04-25T12:50:19.194447+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:19.194447+0000","last_undegraded":"2024-04-25T12:50:19.194447+0000","last_fullsized":"2024-04-25T12:50:19.194447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193280+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:19.193280+0000","last_peered":"2024-04-25T12:50:19.193280+0000","last_clean":"2024-04-25T12:50:19.193280+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:19.193280+0000","last_undegraded":"2024-04-25T12:50:19.193280+0000","last_fullsized":"2024-04-25T12:50:19.193280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193177+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:19.193177+0000","last_peered":"2024-04-25T12:50:19.193177+0000","last_clean":"2024-04-25T12:50:19.193177+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:19.193177+0000","last_undegraded":"2024-04-25T12:50:19.193177+0000","last_fullsized":"2024-04-25T12:50:19.193177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194335+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:19.194335+0000","last_peered":"2024-04-25T12:50:19.194335+0000","last_clean":"2024-04-25T12:50:19.194335+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:19.194335+0000","last_undegraded":"2024-04-25T12:50:19.194335+0000","last_fullsized":"2024-04-25T12:50:19.194335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374456+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:18.374456+0000","last_peered":"2024-04-25T12:50:18.374456+0000","last_clean":"2024-04-25T12:50:18.374456+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:18.374456+0000","last_undegraded":"2024-04-25T12:50:18.374456+0000","last_fullsized":"2024-04-25T12:50:18.374456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373647+0000","last_change":"2024-04-25T12:50:17.392618+0000","last_active":"2024-04-25T12:50:18.373647+0000","last_peered":"2024-04-25T12:50:18.373647+0000","last_clean":"2024-04-25T12:50:18.373647+0000","last_became_active":"2024-04-25T12:50:17.392252+0000","last_became_peered":"2024-04-25T12:50:17.392252+0000","last_unstale":"2024-04-25T12:50:18.373647+0000","last_undegraded":"2024-04-25T12:50:18.373647+0000","last_fullsized":"2024-04-25T12:50:18.373647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:21.181630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193639+0000","last_change":"2024-04-25T12:50:13.367452+0000","last_active":"2024-04-25T12:50:19.193639+0000","last_peered":"2024-04-25T12:50:19.193639+0000","last_clean":"2024-04-25T12:50:19.193639+0000","last_became_active":"2024-04-25T12:50:13.367191+0000","last_became_peered":"2024-04-25T12:50:13.367191+0000","last_unstale":"2024-04-25T12:50:19.193639+0000","last_undegraded":"2024-04-25T12:50:19.193639+0000","last_fullsized":"2024-04-25T12:50:19.193639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:22.674147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192881+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:19.192881+0000","last_peered":"2024-04-25T12:50:19.192881+0000","last_clean":"2024-04-25T12:50:19.192881+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:19.192881+0000","last_undegraded":"2024-04-25T12:50:19.192881+0000","last_fullsized":"2024-04-25T12:50:19.192881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490922+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:18.490922+0000","last_peered":"2024-04-25T12:50:18.490922+0000","last_clean":"2024-04-25T12:50:18.490922+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:18.490922+0000","last_undegraded":"2024-04-25T12:50:18.490922+0000","last_fullsized":"2024-04-25T12:50:18.490922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708208+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:18.708208+0000","last_peered":"2024-04-25T12:50:18.708208+0000","last_clean":"2024-04-25T12:50:18.708208+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:18.708208+0000","last_undegraded":"2024-04-25T12:50:18.708208+0000","last_fullsized":"2024-04-25T12:50:18.708208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708149+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:18.708149+0000","last_peered":"2024-04-25T12:50:18.708149+0000","last_clean":"2024-04-25T12:50:18.708149+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:18.708149+0000","last_undegraded":"2024-04-25T12:50:18.708149+0000","last_fullsized":"2024-04-25T12:50:18.708149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376312+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:18.376312+0000","last_peered":"2024-04-25T12:50:18.376312+0000","last_clean":"2024-04-25T12:50:18.376312+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:18.376312+0000","last_undegraded":"2024-04-25T12:50:18.376312+0000","last_fullsized":"2024-04-25T12:50:18.376312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194172+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:19.194172+0000","last_peered":"2024-04-25T12:50:19.194172+0000","last_clean":"2024-04-25T12:50:19.194172+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:19.194172+0000","last_undegraded":"2024-04-25T12:50:19.194172+0000","last_fullsized":"2024-04-25T12:50:19.194172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193812+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:19.193812+0000","last_peered":"2024-04-25T12:50:19.193812+0000","last_clean":"2024-04-25T12:50:19.193812+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:19.193812+0000","last_undegraded":"2024-04-25T12:50:19.193812+0000","last_fullsized":"2024-04-25T12:50:19.193812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376048+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:18.376048+0000","last_peered":"2024-04-25T12:50:18.376048+0000","last_clean":"2024-04-25T12:50:18.376048+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:18.376048+0000","last_undegraded":"2024-04-25T12:50:18.376048+0000","last_fullsized":"2024-04-25T12:50:18.376048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490628+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:18.490628+0000","last_peered":"2024-04-25T12:50:18.490628+0000","last_clean":"2024-04-25T12:50:18.490628+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:18.490628+0000","last_undegraded":"2024-04-25T12:50:18.490628+0000","last_fullsized":"2024-04-25T12:50:18.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490899+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:18.490899+0000","last_peered":"2024-04-25T12:50:18.490899+0000","last_clean":"2024-04-25T12:50:18.490899+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:18.490899+0000","last_undegraded":"2024-04-25T12:50:18.490899+0000","last_fullsized":"2024-04-25T12:50:18.490899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194059+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:19.194059+0000","last_peered":"2024-04-25T12:50:19.194059+0000","last_clean":"2024-04-25T12:50:19.194059+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:19.194059+0000","last_undegraded":"2024-04-25T12:50:19.194059+0000","last_fullsized":"2024-04-25T12:50:19.194059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193830+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:19.193830+0000","last_peered":"2024-04-25T12:50:19.193830+0000","last_clean":"2024-04-25T12:50:19.193830+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:19.193830+0000","last_undegraded":"2024-04-25T12:50:19.193830+0000","last_fullsized":"2024-04-25T12:50:19.193830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:27.695335+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:27.695335+0000","last_peered":"2024-04-25T12:50:27.695335+0000","last_clean":"2024-04-25T12:50:27.695335+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:27.695335+0000","last_undegraded":"2024-04-25T12:50:27.695335+0000","last_fullsized":"2024-04-25T12:50:27.695335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443311+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:18.443311+0000","last_peered":"2024-04-25T12:50:18.443311+0000","last_clean":"2024-04-25T12:50:18.443311+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:18.443311+0000","last_undegraded":"2024-04-25T12:50:18.443311+0000","last_fullsized":"2024-04-25T12:50:18.443311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374509+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:18.374509+0000","last_peered":"2024-04-25T12:50:18.374509+0000","last_clean":"2024-04-25T12:50:18.374509+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:18.374509+0000","last_undegraded":"2024-04-25T12:50:18.374509+0000","last_fullsized":"2024-04-25T12:50:18.374509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443678+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:18.443678+0000","last_peered":"2024-04-25T12:50:18.443678+0000","last_clean":"2024-04-25T12:50:18.443678+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:18.443678+0000","last_undegraded":"2024-04-25T12:50:18.443678+0000","last_fullsized":"2024-04-25T12:50:18.443678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374070+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:18.374070+0000","last_peered":"2024-04-25T12:50:18.374070+0000","last_clean":"2024-04-25T12:50:18.374070+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:18.374070+0000","last_undegraded":"2024-04-25T12:50:18.374070+0000","last_fullsized":"2024-04-25T12:50:18.374070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490802+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:18.490802+0000","last_peered":"2024-04-25T12:50:18.490802+0000","last_clean":"2024-04-25T12:50:18.490802+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:18.490802+0000","last_undegraded":"2024-04-25T12:50:18.490802+0000","last_fullsized":"2024-04-25T12:50:18.490802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194108+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:19.194108+0000","last_peered":"2024-04-25T12:50:19.194108+0000","last_clean":"2024-04-25T12:50:19.194108+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:19.194108+0000","last_undegraded":"2024-04-25T12:50:19.194108+0000","last_fullsized":"2024-04-25T12:50:19.194108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375750+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:18.375750+0000","last_peered":"2024-04-25T12:50:18.375750+0000","last_clean":"2024-04-25T12:50:18.375750+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:18.375750+0000","last_undegraded":"2024-04-25T12:50:18.375750+0000","last_fullsized":"2024-04-25T12:50:18.375750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194015+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:19.194015+0000","last_peered":"2024-04-25T12:50:19.194015+0000","last_clean":"2024-04-25T12:50:19.194015+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:19.194015+0000","last_undegraded":"2024-04-25T12:50:19.194015+0000","last_fullsized":"2024-04-25T12:50:19.194015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708598+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:18.708598+0000","last_peered":"2024-04-25T12:50:18.708598+0000","last_clean":"2024-04-25T12:50:18.708598+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:18.708598+0000","last_undegraded":"2024-04-25T12:50:18.708598+0000","last_fullsized":"2024-04-25T12:50:18.708598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375629+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:18.375629+0000","last_peered":"2024-04-25T12:50:18.375629+0000","last_clean":"2024-04-25T12:50:18.375629+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:18.375629+0000","last_undegraded":"2024-04-25T12:50:18.375629+0000","last_fullsized":"2024-04-25T12:50:18.375629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490933+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:18.490933+0000","last_peered":"2024-04-25T12:50:18.490933+0000","last_clean":"2024-04-25T12:50:18.490933+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:18.490933+0000","last_undegraded":"2024-04-25T12:50:18.490933+0000","last_fullsized":"2024-04-25T12:50:18.490933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443059+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:18.443059+0000","last_peered":"2024-04-25T12:50:18.443059+0000","last_clean":"2024-04-25T12:50:18.443059+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:18.443059+0000","last_undegraded":"2024-04-25T12:50:18.443059+0000","last_fullsized":"2024-04-25T12:50:18.443059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193400+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:19.193400+0000","last_peered":"2024-04-25T12:50:19.193400+0000","last_clean":"2024-04-25T12:50:19.193400+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:19.193400+0000","last_undegraded":"2024-04-25T12:50:19.193400+0000","last_fullsized":"2024-04-25T12:50:19.193400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708614+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:18.708614+0000","last_peered":"2024-04-25T12:50:18.708614+0000","last_clean":"2024-04-25T12:50:18.708614+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:18.708614+0000","last_undegraded":"2024-04-25T12:50:18.708614+0000","last_fullsized":"2024-04-25T12:50:18.708614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375619+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:18.375619+0000","last_peered":"2024-04-25T12:50:18.375619+0000","last_clean":"2024-04-25T12:50:18.375619+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:18.375619+0000","last_undegraded":"2024-04-25T12:50:18.375619+0000","last_fullsized":"2024-04-25T12:50:18.375619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375790+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:18.375790+0000","last_peered":"2024-04-25T12:50:18.375790+0000","last_clean":"2024-04-25T12:50:18.375790+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:18.375790+0000","last_undegraded":"2024-04-25T12:50:18.375790+0000","last_fullsized":"2024-04-25T12:50:18.375790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708432+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:18.708432+0000","last_peered":"2024-04-25T12:50:18.708432+0000","last_clean":"2024-04-25T12:50:18.708432+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:18.708432+0000","last_undegraded":"2024-04-25T12:50:18.708432+0000","last_fullsized":"2024-04-25T12:50:18.708432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490790+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:18.490790+0000","last_peered":"2024-04-25T12:50:18.490790+0000","last_clean":"2024-04-25T12:50:18.490790+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:18.490790+0000","last_undegraded":"2024-04-25T12:50:18.490790+0000","last_fullsized":"2024-04-25T12:50:18.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193090+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:19.193090+0000","last_peered":"2024-04-25T12:50:19.193090+0000","last_clean":"2024-04-25T12:50:19.193090+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:19.193090+0000","last_undegraded":"2024-04-25T12:50:19.193090+0000","last_fullsized":"2024-04-25T12:50:19.193090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375880+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:18.375880+0000","last_peered":"2024-04-25T12:50:18.375880+0000","last_clean":"2024-04-25T12:50:18.375880+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:18.375880+0000","last_undegraded":"2024-04-25T12:50:18.375880+0000","last_fullsized":"2024-04-25T12:50:18.375880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374019+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:18.374019+0000","last_peered":"2024-04-25T12:50:18.374019+0000","last_clean":"2024-04-25T12:50:18.374019+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:18.374019+0000","last_undegraded":"2024-04-25T12:50:18.374019+0000","last_fullsized":"2024-04-25T12:50:18.374019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375974+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:18.375974+0000","last_peered":"2024-04-25T12:50:18.375974+0000","last_clean":"2024-04-25T12:50:18.375974+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:18.375974+0000","last_undegraded":"2024-04-25T12:50:18.375974+0000","last_fullsized":"2024-04-25T12:50:18.375974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707993+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:18.707993+0000","last_peered":"2024-04-25T12:50:18.707993+0000","last_clean":"2024-04-25T12:50:18.707993+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:18.707993+0000","last_undegraded":"2024-04-25T12:50:18.707993+0000","last_fullsized":"2024-04-25T12:50:18.707993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192896+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:19.192896+0000","last_peered":"2024-04-25T12:50:19.192896+0000","last_clean":"2024-04-25T12:50:19.192896+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:19.192896+0000","last_undegraded":"2024-04-25T12:50:19.192896+0000","last_fullsized":"2024-04-25T12:50:19.192896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193566+0000","last_change":"2024-04-25T12:50:13.358445+0000","last_active":"2024-04-25T12:50:19.193566+0000","last_peered":"2024-04-25T12:50:19.193566+0000","last_clean":"2024-04-25T12:50:19.193566+0000","last_became_active":"2024-04-25T12:50:13.358182+0000","last_became_peered":"2024-04-25T12:50:13.358182+0000","last_unstale":"2024-04-25T12:50:19.193566+0000","last_undegraded":"2024-04-25T12:50:19.193566+0000","last_fullsized":"2024-04-25T12:50:19.193566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:46.419647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490749+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:18.490749+0000","last_peered":"2024-04-25T12:50:18.490749+0000","last_clean":"2024-04-25T12:50:18.490749+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:18.490749+0000","last_undegraded":"2024-04-25T12:50:18.490749+0000","last_fullsized":"2024-04-25T12:50:18.490749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376132+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:18.376132+0000","last_peered":"2024-04-25T12:50:18.376132+0000","last_clean":"2024-04-25T12:50:18.376132+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:18.376132+0000","last_undegraded":"2024-04-25T12:50:18.376132+0000","last_fullsized":"2024-04-25T12:50:18.376132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443568+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:18.443568+0000","last_peered":"2024-04-25T12:50:18.443568+0000","last_clean":"2024-04-25T12:50:18.443568+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:18.443568+0000","last_undegraded":"2024-04-25T12:50:18.443568+0000","last_fullsized":"2024-04-25T12:50:18.443568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708601+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:18.708601+0000","last_peered":"2024-04-25T12:50:18.708601+0000","last_clean":"2024-04-25T12:50:18.708601+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:18.708601+0000","last_undegraded":"2024-04-25T12:50:18.708601+0000","last_fullsized":"2024-04-25T12:50:18.708601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376259+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:18.376259+0000","last_peered":"2024-04-25T12:50:18.376259+0000","last_clean":"2024-04-25T12:50:18.376259+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:18.376259+0000","last_undegraded":"2024-04-25T12:50:18.376259+0000","last_fullsized":"2024-04-25T12:50:18.376259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193289+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:19.193289+0000","last_peered":"2024-04-25T12:50:19.193289+0000","last_clean":"2024-04-25T12:50:19.193289+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:19.193289+0000","last_undegraded":"2024-04-25T12:50:19.193289+0000","last_fullsized":"2024-04-25T12:50:19.193289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375698+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:18.375698+0000","last_peered":"2024-04-25T12:50:18.375698+0000","last_clean":"2024-04-25T12:50:18.375698+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:18.375698+0000","last_undegraded":"2024-04-25T12:50:18.375698+0000","last_fullsized":"2024-04-25T12:50:18.375698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193540+0000","last_change":"2024-04-25T12:50:13.369544+0000","last_active":"2024-04-25T12:50:19.193540+0000","last_peered":"2024-04-25T12:50:19.193540+0000","last_clean":"2024-04-25T12:50:19.193540+0000","last_became_active":"2024-04-25T12:50:13.369254+0000","last_became_peered":"2024-04-25T12:50:13.369254+0000","last_unstale":"2024-04-25T12:50:19.193540+0000","last_undegraded":"2024-04-25T12:50:19.193540+0000","last_fullsized":"2024-04-25T12:50:19.193540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:07.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490531+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:18.490531+0000","last_peered":"2024-04-25T12:50:18.490531+0000","last_clean":"2024-04-25T12:50:18.490531+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:18.490531+0000","last_undegraded":"2024-04-25T12:50:18.490531+0000","last_fullsized":"2024-04-25T12:50:18.490531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708357+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:18.708357+0000","last_peered":"2024-04-25T12:50:18.708357+0000","last_clean":"2024-04-25T12:50:18.708357+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:18.708357+0000","last_undegraded":"2024-04-25T12:50:18.708357+0000","last_fullsized":"2024-04-25T12:50:18.708357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194284+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:19.194284+0000","last_peered":"2024-04-25T12:50:19.194284+0000","last_clean":"2024-04-25T12:50:19.194284+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:19.194284+0000","last_undegraded":"2024-04-25T12:50:19.194284+0000","last_fullsized":"2024-04-25T12:50:19.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193222+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:19.193222+0000","last_peered":"2024-04-25T12:50:19.193222+0000","last_clean":"2024-04-25T12:50:19.193222+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:19.193222+0000","last_undegraded":"2024-04-25T12:50:19.193222+0000","last_fullsized":"2024-04-25T12:50:19.193222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194416+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:19.194416+0000","last_peered":"2024-04-25T12:50:19.194416+0000","last_clean":"2024-04-25T12:50:19.194416+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:19.194416+0000","last_undegraded":"2024-04-25T12:50:19.194416+0000","last_fullsized":"2024-04-25T12:50:19.194416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193130+0000","last_change":"2024-04-25T12:50:13.361730+0000","last_active":"2024-04-25T12:50:19.193130+0000","last_peered":"2024-04-25T12:50:19.193130+0000","last_clean":"2024-04-25T12:50:19.193130+0000","last_became_active":"2024-04-25T12:50:13.361305+0000","last_became_peered":"2024-04-25T12:50:13.361305+0000","last_unstale":"2024-04-25T12:50:19.193130+0000","last_undegraded":"2024-04-25T12:50:19.193130+0000","last_fullsized":"2024-04-25T12:50:19.193130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.112968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443125+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:18.443125+0000","last_peered":"2024-04-25T12:50:18.443125+0000","last_clean":"2024-04-25T12:50:18.443125+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:18.443125+0000","last_undegraded":"2024-04-25T12:50:18.443125+0000","last_fullsized":"2024-04-25T12:50:18.443125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490744+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:18.490744+0000","last_peered":"2024-04-25T12:50:18.490744+0000","last_clean":"2024-04-25T12:50:18.490744+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:18.490744+0000","last_undegraded":"2024-04-25T12:50:18.490744+0000","last_fullsized":"2024-04-25T12:50:18.490744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375678+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:18.375678+0000","last_peered":"2024-04-25T12:50:18.375678+0000","last_clean":"2024-04-25T12:50:18.375678+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:18.375678+0000","last_undegraded":"2024-04-25T12:50:18.375678+0000","last_fullsized":"2024-04-25T12:50:18.375678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374421+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:18.374421+0000","last_peered":"2024-04-25T12:50:18.374421+0000","last_clean":"2024-04-25T12:50:18.374421+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:18.374421+0000","last_undegraded":"2024-04-25T12:50:18.374421+0000","last_fullsized":"2024-04-25T12:50:18.374421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708474+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:18.708474+0000","last_peered":"2024-04-25T12:50:18.708474+0000","last_clean":"2024-04-25T12:50:18.708474+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:18.708474+0000","last_undegraded":"2024-04-25T12:50:18.708474+0000","last_fullsized":"2024-04-25T12:50:18.708474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708530+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:18.708530+0000","last_peered":"2024-04-25T12:50:18.708530+0000","last_clean":"2024-04-25T12:50:18.708530+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:18.708530+0000","last_undegraded":"2024-04-25T12:50:18.708530+0000","last_fullsized":"2024-04-25T12:50:18.708530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194342+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:19.194342+0000","last_peered":"2024-04-25T12:50:19.194342+0000","last_clean":"2024-04-25T12:50:19.194342+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:19.194342+0000","last_undegraded":"2024-04-25T12:50:19.194342+0000","last_fullsized":"2024-04-25T12:50:19.194342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375421+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:18.375421+0000","last_peered":"2024-04-25T12:50:18.375421+0000","last_clean":"2024-04-25T12:50:18.375421+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:18.375421+0000","last_undegraded":"2024-04-25T12:50:18.375421+0000","last_fullsized":"2024-04-25T12:50:18.375421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193509+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:19.193509+0000","last_peered":"2024-04-25T12:50:19.193509+0000","last_clean":"2024-04-25T12:50:19.193509+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:19.193509+0000","last_undegraded":"2024-04-25T12:50:19.193509+0000","last_fullsized":"2024-04-25T12:50:19.193509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193428+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:19.193428+0000","last_peered":"2024-04-25T12:50:19.193428+0000","last_clean":"2024-04-25T12:50:19.193428+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:19.193428+0000","last_undegraded":"2024-04-25T12:50:19.193428+0000","last_fullsized":"2024-04-25T12:50:19.193428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193961+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:19.193961+0000","last_peered":"2024-04-25T12:50:19.193961+0000","last_clean":"2024-04-25T12:50:19.193961+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:19.193961+0000","last_undegraded":"2024-04-25T12:50:19.193961+0000","last_fullsized":"2024-04-25T12:50:19.193961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194637+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:19.194637+0000","last_peered":"2024-04-25T12:50:19.194637+0000","last_clean":"2024-04-25T12:50:19.194637+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:19.194637+0000","last_undegraded":"2024-04-25T12:50:19.194637+0000","last_fullsized":"2024-04-25T12:50:19.194637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490720+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:18.490720+0000","last_peered":"2024-04-25T12:50:18.490720+0000","last_clean":"2024-04-25T12:50:18.490720+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:18.490720+0000","last_undegraded":"2024-04-25T12:50:18.490720+0000","last_fullsized":"2024-04-25T12:50:18.490720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443835+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:18.443835+0000","last_peered":"2024-04-25T12:50:18.443835+0000","last_clean":"2024-04-25T12:50:18.443835+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:18.443835+0000","last_undegraded":"2024-04-25T12:50:18.443835+0000","last_fullsized":"2024-04-25T12:50:18.443835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194154+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:19.194154+0000","last_peered":"2024-04-25T12:50:19.194154+0000","last_clean":"2024-04-25T12:50:19.194154+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:19.194154+0000","last_undegraded":"2024-04-25T12:50:19.194154+0000","last_fullsized":"2024-04-25T12:50:19.194154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":104457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":104493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":104367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:46.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:46.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.898+0000 7fe71cbfe640 1 Processor -- start 2024-04-25T12:50:46.896 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.898+0000 7fe71cbfe640 1 -- start start 2024-04-25T12:50:46.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71cbfe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fe718152380 0x7fe718157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71cbfe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 0x7fe71815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71cbfe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe71815b500 con 0x7fe718151fa0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71cbfe640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fe71815bae0 con 0x7fe718152380 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71cbfe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe7180c52f0 con 0x7fe7180c4cc0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe718151fa0 0x7fe7180c8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37018/0 (socket says 172.21.15.132:37018) 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71659c640 1 -- 172.21.15.132:0/3284515518 learned_addr learned my addr 172.21.15.132:0/3284515518 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe715d9b640 1 --2- 172.21.15.132:0/3284515518 >> v2:172.21.15.157:3300/0 conn(0x7fe718152380 0x7fe718157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe716d9d640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 0x7fe71815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751740685 0 0) 0x7fe71815b500 con 0x7fe718151fa0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe700003520 con 0x7fe718151fa0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 552562617 0 0) 0x7fe700003520 con 0x7fe718151fa0 2024-04-25T12:50:46.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 msgr2=0x7fe71815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 0x7fe71815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 >> v2:172.21.15.157:3300/0 conn(0x7fe718152380 msgr2=0x7fe718157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 --2- 172.21.15.132:0/3284515518 >> v2:172.21.15.157:3300/0 conn(0x7fe718152380 0x7fe718157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7180c55d0 con 0x7fe718151fa0 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7fe70c001670 con 0x7fe718151fa0 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 >> v1:172.21.15.132:6789/0 conn(0x7fe718151fa0 legacy=0x7fe7180c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 0x7fe7000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700003f30 0x7fe700004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe700004d40 0x7fe7000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe71815bae0 con 0x7fe700003f30 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7180c52f0 con 0x7fe700004d40 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe70000b9c0 con 0x7fe7180c4cc0 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.899+0000 7fe715d9b640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700003f30 0x7fe700004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe71659c640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 0x7fe7000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe716d9d640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe700004d40 0x7fe7000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe715d9b640 1 -- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 msgr2=0x7fe7000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe715d9b640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe7180c4cc0 0x7fe7000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe715d9b640 1 -- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe700004d40 msgr2=0x7fe7000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe715d9b640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe700004d40 0x7fe7000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe715d9b640 1 -- 172.21.15.132:0/3284515518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe700003520 con 0x7fe700003f30 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.900+0000 7fe715d9b640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700003f30 0x7fe700004800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe708009a90 tx=0x7fe700005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d0948e7e8748d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708036070 con 0x7fe700003f30 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe708031400 con 0x7fe700003f30 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71559a640 1 -- 172.21.15.132:0/3284515518 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708009690 con 0x7fe700003f30 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71cbfe640 1 -- 172.21.15.132:0/3284515518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700003f30 msgr2=0x7fe700004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/3284515518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe700003f30 0x7fe700004800 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe708009a90 tx=0x7fe700005830 comp rx=0 tx=0).stop 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe716d9d640 1 -- 172.21.15.132:0/3284515518 reap_dead start 2024-04-25T12:50:46.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71cbfe640 1 -- 172.21.15.132:0/3284515518 shutdown_connections 2024-04-25T12:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71cbfe640 1 -- 172.21.15.132:0/3284515518 >> 172.21.15.132:0/3284515518 conn(0x7fe718067630 msgr2=0x7fe718067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71cbfe640 1 -- 172.21.15.132:0/3284515518 shutdown_connections 2024-04-25T12:50:46.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.901+0000 7fe71cbfe640 1 -- 172.21.15.132:0/3284515518 wait complete. 2024-04-25T12:50:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.902+0000 7fe71cbfe640 1 Processor -- start 2024-04-25T12:50:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 -- start start 2024-04-25T12:50:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe700003f30 0x7fe7181edd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 0x7fe7181573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe71814c560 0x7fe718146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe7180c3bc0 con 0x7fe7181f12b0 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe7180c58b0 con 0x7fe71814c560 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe71cbfe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe71815bf70 con 0x7fe700003f30 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe715d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 0x7fe7181573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe715d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 0x7fe7181573d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51692/0 (socket says 172.21.15.132:51692) 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe715d9b640 1 -- 172.21.15.132:0/452163791 learned_addr learned my addr 172.21.15.132:0/452163791 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.903+0000 7fe716d9d640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe71814c560 0x7fe718146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe715d9b640 1 -- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe700003f30 msgr2=0x7fe7181edd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe715d9b640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe700003f30 0x7fe7181edd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe715d9b640 1 -- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe71814c560 msgr2=0x7fe718146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe715d9b640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe71814c560 0x7fe718146f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe715d9b640 1 -- 172.21.15.132:0/452163791 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7181ee280 con 0x7fe7181f12b0 2024-04-25T12:50:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe715d9b640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 0x7fe7181573d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe708009bb0 tx=0x7fe708004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708040020 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe708003c60 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7181ee4f0 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe708036040 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.904+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7181eeab0 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.905+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe718068c20 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.905+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe708043020 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.906+0000 7fe706ffd640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe6f806c8f0 0x7fe6f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.906+0000 7fe71659c640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe6f806c8f0 0x7fe6f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.906+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe7080abf90 con 0x7fe7181f12b0 2024-04-25T12:50:46.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.906+0000 7fe71659c640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe6f806c8f0 0x7fe6f806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0014f0 tx=0x7fe70c007bf0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:46.910+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe70804a070 con 0x7fe7181f12b0 2024-04-25T12:50:47.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.081+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe7181eec80 con 0x7fe6f806c8f0 2024-04-25T12:50:47.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.089+0000 7fe706ffd640 1 -- 172.21.15.132:0/452163791 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332533 (secure 0 0 0) 0x7fe7181eec80 con 0x7fe6f806c8f0 2024-04-25T12:50:47.090 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:47.092 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe6f806c8f0 msgr2=0x7fe6f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe6f806c8f0 0x7fe6f806edb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe70c0014f0 tx=0x7fe70c007bf0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 msgr2=0x7fe7181573d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 0x7fe7181573d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe708009bb0 tx=0x7fe708004730 comp rx=0 tx=0).stop 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 shutdown_connections 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe6f806c8f0 0x7fe6f806edb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe71814c560 0x7fe718146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7181f12b0 0x7fe7181573d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 --2- 172.21.15.132:0/452163791 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe700003f30 0x7fe7181edd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 >> 172.21.15.132:0/452163791 conn(0x7fe718067630 msgr2=0x7fe7180c3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 shutdown_connections 2024-04-25T12:50:47.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.092+0000 7fe71cbfe640 1 -- 172.21.15.132:0/452163791 wait complete. 2024-04-25T12:50:47.102 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-25T12:50:45.134160+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":231920,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742800,"statfs":{"total":773094113280,"available":772856627200,"internally_reserved":0,"allocated":3350528,"data_stored":2024952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003269"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490836+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:18.490836+0000","last_peered":"2024-04-25T12:50:18.490836+0000","last_clean":"2024-04-25T12:50:18.490836+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:18.490836+0000","last_undegraded":"2024-04-25T12:50:18.490836+0000","last_fullsized":"2024-04-25T12:50:18.490836+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376123+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:18.376123+0000","last_peered":"2024-04-25T12:50:18.376123+0000","last_clean":"2024-04-25T12:50:18.376123+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:18.376123+0000","last_undegraded":"2024-04-25T12:50:18.376123+0000","last_fullsized":"2024-04-25T12:50:18.376123+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375559+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:18.375559+0000","last_peered":"2024-04-25T12:50:18.375559+0000","last_clean":"2024-04-25T12:50:18.375559+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:18.375559+0000","last_undegraded":"2024-04-25T12:50:18.375559+0000","last_fullsized":"2024-04-25T12:50:18.375559+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376235+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:18.376235+0000","last_peered":"2024-04-25T12:50:18.376235+0000","last_clean":"2024-04-25T12:50:18.376235+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:18.376235+0000","last_undegraded":"2024-04-25T12:50:18.376235+0000","last_fullsized":"2024-04-25T12:50:18.376235+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490678+0000","last_change":"2024-04-25T12:50:13.364716+0000","last_active":"2024-04-25T12:50:18.490678+0000","last_peered":"2024-04-25T12:50:18.490678+0000","last_clean":"2024-04-25T12:50:18.490678+0000","last_became_active":"2024-04-25T12:50:13.364220+0000","last_became_peered":"2024-04-25T12:50:13.364220+0000","last_unstale":"2024-04-25T12:50:18.490678+0000","last_undegraded":"2024-04-25T12:50:18.490678+0000","last_fullsized":"2024-04-25T12:50:18.490678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:44:04.451868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373674+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:18.373674+0000","last_peered":"2024-04-25T12:50:18.373674+0000","last_clean":"2024-04-25T12:50:18.373674+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:18.373674+0000","last_undegraded":"2024-04-25T12:50:18.373674+0000","last_fullsized":"2024-04-25T12:50:18.373674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194164+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:19.194164+0000","last_peered":"2024-04-25T12:50:19.194164+0000","last_clean":"2024-04-25T12:50:19.194164+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:19.194164+0000","last_undegraded":"2024-04-25T12:50:19.194164+0000","last_fullsized":"2024-04-25T12:50:19.194164+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194639+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:19.194639+0000","last_peered":"2024-04-25T12:50:19.194639+0000","last_clean":"2024-04-25T12:50:19.194639+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:19.194639+0000","last_undegraded":"2024-04-25T12:50:19.194639+0000","last_fullsized":"2024-04-25T12:50:19.194639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373856+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:18.373856+0000","last_peered":"2024-04-25T12:50:18.373856+0000","last_clean":"2024-04-25T12:50:18.373856+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:18.373856+0000","last_undegraded":"2024-04-25T12:50:18.373856+0000","last_fullsized":"2024-04-25T12:50:18.373856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193649+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:19.193649+0000","last_peered":"2024-04-25T12:50:19.193649+0000","last_clean":"2024-04-25T12:50:19.193649+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:19.193649+0000","last_undegraded":"2024-04-25T12:50:19.193649+0000","last_fullsized":"2024-04-25T12:50:19.193649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194115+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:19.194115+0000","last_peered":"2024-04-25T12:50:19.194115+0000","last_clean":"2024-04-25T12:50:19.194115+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:19.194115+0000","last_undegraded":"2024-04-25T12:50:19.194115+0000","last_fullsized":"2024-04-25T12:50:19.194115+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373780+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:18.373780+0000","last_peered":"2024-04-25T12:50:18.373780+0000","last_clean":"2024-04-25T12:50:18.373780+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:18.373780+0000","last_undegraded":"2024-04-25T12:50:18.373780+0000","last_fullsized":"2024-04-25T12:50:18.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707963+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:18.707963+0000","last_peered":"2024-04-25T12:50:18.707963+0000","last_clean":"2024-04-25T12:50:18.707963+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:18.707963+0000","last_undegraded":"2024-04-25T12:50:18.707963+0000","last_fullsized":"2024-04-25T12:50:18.707963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194274+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:19.194274+0000","last_peered":"2024-04-25T12:50:19.194274+0000","last_clean":"2024-04-25T12:50:19.194274+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:19.194274+0000","last_undegraded":"2024-04-25T12:50:19.194274+0000","last_fullsized":"2024-04-25T12:50:19.194274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374554+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:18.374554+0000","last_peered":"2024-04-25T12:50:18.374554+0000","last_clean":"2024-04-25T12:50:18.374554+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:18.374554+0000","last_undegraded":"2024-04-25T12:50:18.374554+0000","last_fullsized":"2024-04-25T12:50:18.374554+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375774+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:18.375774+0000","last_peered":"2024-04-25T12:50:18.375774+0000","last_clean":"2024-04-25T12:50:18.375774+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:18.375774+0000","last_undegraded":"2024-04-25T12:50:18.375774+0000","last_fullsized":"2024-04-25T12:50:18.375774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443390+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:18.443390+0000","last_peered":"2024-04-25T12:50:18.443390+0000","last_clean":"2024-04-25T12:50:18.443390+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:18.443390+0000","last_undegraded":"2024-04-25T12:50:18.443390+0000","last_fullsized":"2024-04-25T12:50:18.443390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374576+0000","last_change":"2024-04-25T12:50:17.391816+0000","last_active":"2024-04-25T12:50:18.374576+0000","last_peered":"2024-04-25T12:50:18.374576+0000","last_clean":"2024-04-25T12:50:18.374576+0000","last_became_active":"2024-04-25T12:50:17.390690+0000","last_became_peered":"2024-04-25T12:50:17.390690+0000","last_unstale":"2024-04-25T12:50:18.374576+0000","last_undegraded":"2024-04-25T12:50:18.374576+0000","last_fullsized":"2024-04-25T12:50:18.374576+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:24:25.879819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375734+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:18.375734+0000","last_peered":"2024-04-25T12:50:18.375734+0000","last_clean":"2024-04-25T12:50:18.375734+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:18.375734+0000","last_undegraded":"2024-04-25T12:50:18.375734+0000","last_fullsized":"2024-04-25T12:50:18.375734+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443166+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:18.443166+0000","last_peered":"2024-04-25T12:50:18.443166+0000","last_clean":"2024-04-25T12:50:18.443166+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:18.443166+0000","last_undegraded":"2024-04-25T12:50:18.443166+0000","last_fullsized":"2024-04-25T12:50:18.443166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443959+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:18.443959+0000","last_peered":"2024-04-25T12:50:18.443959+0000","last_clean":"2024-04-25T12:50:18.443959+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:18.443959+0000","last_undegraded":"2024-04-25T12:50:18.443959+0000","last_fullsized":"2024-04-25T12:50:18.443959+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373924+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:18.373924+0000","last_peered":"2024-04-25T12:50:18.373924+0000","last_clean":"2024-04-25T12:50:18.373924+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:18.373924+0000","last_undegraded":"2024-04-25T12:50:18.373924+0000","last_fullsized":"2024-04-25T12:50:18.373924+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193144+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:19.193144+0000","last_peered":"2024-04-25T12:50:19.193144+0000","last_clean":"2024-04-25T12:50:19.193144+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:19.193144+0000","last_undegraded":"2024-04-25T12:50:19.193144+0000","last_fullsized":"2024-04-25T12:50:19.193144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374315+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:18.374315+0000","last_peered":"2024-04-25T12:50:18.374315+0000","last_clean":"2024-04-25T12:50:18.374315+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:18.374315+0000","last_undegraded":"2024-04-25T12:50:18.374315+0000","last_fullsized":"2024-04-25T12:50:18.374315+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491033+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:18.491033+0000","last_peered":"2024-04-25T12:50:18.491033+0000","last_clean":"2024-04-25T12:50:18.491033+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:18.491033+0000","last_undegraded":"2024-04-25T12:50:18.491033+0000","last_fullsized":"2024-04-25T12:50:18.491033+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708733+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:18.708733+0000","last_peered":"2024-04-25T12:50:18.708733+0000","last_clean":"2024-04-25T12:50:18.708733+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:18.708733+0000","last_undegraded":"2024-04-25T12:50:18.708733+0000","last_fullsized":"2024-04-25T12:50:18.708733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373854+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:18.373854+0000","last_peered":"2024-04-25T12:50:18.373854+0000","last_clean":"2024-04-25T12:50:18.373854+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:18.373854+0000","last_undegraded":"2024-04-25T12:50:18.373854+0000","last_fullsized":"2024-04-25T12:50:18.373854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376351+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:18.376351+0000","last_peered":"2024-04-25T12:50:18.376351+0000","last_clean":"2024-04-25T12:50:18.376351+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:18.376351+0000","last_undegraded":"2024-04-25T12:50:18.376351+0000","last_fullsized":"2024-04-25T12:50:18.376351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443909+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:18.443909+0000","last_peered":"2024-04-25T12:50:18.443909+0000","last_clean":"2024-04-25T12:50:18.443909+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:18.443909+0000","last_undegraded":"2024-04-25T12:50:18.443909+0000","last_fullsized":"2024-04-25T12:50:18.443909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375492+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:18.375492+0000","last_peered":"2024-04-25T12:50:18.375492+0000","last_clean":"2024-04-25T12:50:18.375492+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:18.375492+0000","last_undegraded":"2024-04-25T12:50:18.375492+0000","last_fullsized":"2024-04-25T12:50:18.375492+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443634+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:18.443634+0000","last_peered":"2024-04-25T12:50:18.443634+0000","last_clean":"2024-04-25T12:50:18.443634+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:18.443634+0000","last_undegraded":"2024-04-25T12:50:18.443634+0000","last_fullsized":"2024-04-25T12:50:18.443634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194390+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:19.194390+0000","last_peered":"2024-04-25T12:50:19.194390+0000","last_clean":"2024-04-25T12:50:19.194390+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:19.194390+0000","last_undegraded":"2024-04-25T12:50:19.194390+0000","last_fullsized":"2024-04-25T12:50:19.194390+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490617+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:18.490617+0000","last_peered":"2024-04-25T12:50:18.490617+0000","last_clean":"2024-04-25T12:50:18.490617+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:18.490617+0000","last_undegraded":"2024-04-25T12:50:18.490617+0000","last_fullsized":"2024-04-25T12:50:18.490617+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194216+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:19.194216+0000","last_peered":"2024-04-25T12:50:19.194216+0000","last_clean":"2024-04-25T12:50:19.194216+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:19.194216+0000","last_undegraded":"2024-04-25T12:50:19.194216+0000","last_fullsized":"2024-04-25T12:50:19.194216+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443733+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:18.443733+0000","last_peered":"2024-04-25T12:50:18.443733+0000","last_clean":"2024-04-25T12:50:18.443733+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:18.443733+0000","last_undegraded":"2024-04-25T12:50:18.443733+0000","last_fullsized":"2024-04-25T12:50:18.443733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443260+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:18.443260+0000","last_peered":"2024-04-25T12:50:18.443260+0000","last_clean":"2024-04-25T12:50:18.443260+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:18.443260+0000","last_undegraded":"2024-04-25T12:50:18.443260+0000","last_fullsized":"2024-04-25T12:50:18.443260+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374282+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:18.374282+0000","last_peered":"2024-04-25T12:50:18.374282+0000","last_clean":"2024-04-25T12:50:18.374282+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:18.374282+0000","last_undegraded":"2024-04-25T12:50:18.374282+0000","last_fullsized":"2024-04-25T12:50:18.374282+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193689+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:19.193689+0000","last_peered":"2024-04-25T12:50:19.193689+0000","last_clean":"2024-04-25T12:50:19.193689+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:19.193689+0000","last_undegraded":"2024-04-25T12:50:19.193689+0000","last_fullsized":"2024-04-25T12:50:19.193689+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443658+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:18.443658+0000","last_peered":"2024-04-25T12:50:18.443658+0000","last_clean":"2024-04-25T12:50:18.443658+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:18.443658+0000","last_undegraded":"2024-04-25T12:50:18.443658+0000","last_fullsized":"2024-04-25T12:50:18.443658+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443155+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:18.443155+0000","last_peered":"2024-04-25T12:50:18.443155+0000","last_clean":"2024-04-25T12:50:18.443155+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:18.443155+0000","last_undegraded":"2024-04-25T12:50:18.443155+0000","last_fullsized":"2024-04-25T12:50:18.443155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193161+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:19.193161+0000","last_peered":"2024-04-25T12:50:19.193161+0000","last_clean":"2024-04-25T12:50:19.193161+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:19.193161+0000","last_undegraded":"2024-04-25T12:50:19.193161+0000","last_fullsized":"2024-04-25T12:50:19.193161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443997+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:18.443997+0000","last_peered":"2024-04-25T12:50:18.443997+0000","last_clean":"2024-04-25T12:50:18.443997+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:18.443997+0000","last_undegraded":"2024-04-25T12:50:18.443997+0000","last_fullsized":"2024-04-25T12:50:18.443997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490428+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:18.490428+0000","last_peered":"2024-04-25T12:50:18.490428+0000","last_clean":"2024-04-25T12:50:18.490428+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:18.490428+0000","last_undegraded":"2024-04-25T12:50:18.490428+0000","last_fullsized":"2024-04-25T12:50:18.490428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193145+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:19.193145+0000","last_peered":"2024-04-25T12:50:19.193145+0000","last_clean":"2024-04-25T12:50:19.193145+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:19.193145+0000","last_undegraded":"2024-04-25T12:50:19.193145+0000","last_fullsized":"2024-04-25T12:50:19.193145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.491068+0000","last_change":"2024-04-25T12:50:17.401693+0000","last_active":"2024-04-25T12:50:18.491068+0000","last_peered":"2024-04-25T12:50:18.491068+0000","last_clean":"2024-04-25T12:50:18.491068+0000","last_became_active":"2024-04-25T12:50:17.401301+0000","last_became_peered":"2024-04-25T12:50:17.401301+0000","last_unstale":"2024-04-25T12:50:18.491068+0000","last_undegraded":"2024-04-25T12:50:18.491068+0000","last_fullsized":"2024-04-25T12:50:18.491068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:39:18.863162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375470+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:18.375470+0000","last_peered":"2024-04-25T12:50:18.375470+0000","last_clean":"2024-04-25T12:50:18.375470+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:18.375470+0000","last_undegraded":"2024-04-25T12:50:18.375470+0000","last_fullsized":"2024-04-25T12:50:18.375470+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193598+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:19.193598+0000","last_peered":"2024-04-25T12:50:19.193598+0000","last_clean":"2024-04-25T12:50:19.193598+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:19.193598+0000","last_undegraded":"2024-04-25T12:50:19.193598+0000","last_fullsized":"2024-04-25T12:50:19.193598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193275+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:19.193275+0000","last_peered":"2024-04-25T12:50:19.193275+0000","last_clean":"2024-04-25T12:50:19.193275+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:19.193275+0000","last_undegraded":"2024-04-25T12:50:19.193275+0000","last_fullsized":"2024-04-25T12:50:19.193275+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708408+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:18.708408+0000","last_peered":"2024-04-25T12:50:18.708408+0000","last_clean":"2024-04-25T12:50:18.708408+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:18.708408+0000","last_undegraded":"2024-04-25T12:50:18.708408+0000","last_fullsized":"2024-04-25T12:50:18.708408+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193953+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:19.193953+0000","last_peered":"2024-04-25T12:50:19.193953+0000","last_clean":"2024-04-25T12:50:19.193953+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:19.193953+0000","last_undegraded":"2024-04-25T12:50:19.193953+0000","last_fullsized":"2024-04-25T12:50:19.193953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193281+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:19.193281+0000","last_peered":"2024-04-25T12:50:19.193281+0000","last_clean":"2024-04-25T12:50:19.193281+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:19.193281+0000","last_undegraded":"2024-04-25T12:50:19.193281+0000","last_fullsized":"2024-04-25T12:50:19.193281+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708109+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:18.708109+0000","last_peered":"2024-04-25T12:50:18.708109+0000","last_clean":"2024-04-25T12:50:18.708109+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:18.708109+0000","last_undegraded":"2024-04-25T12:50:18.708109+0000","last_fullsized":"2024-04-25T12:50:18.708109+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194752+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:19.194752+0000","last_peered":"2024-04-25T12:50:19.194752+0000","last_clean":"2024-04-25T12:50:19.194752+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:19.194752+0000","last_undegraded":"2024-04-25T12:50:19.194752+0000","last_fullsized":"2024-04-25T12:50:19.194752+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443731+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:18.443731+0000","last_peered":"2024-04-25T12:50:18.443731+0000","last_clean":"2024-04-25T12:50:18.443731+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:18.443731+0000","last_undegraded":"2024-04-25T12:50:18.443731+0000","last_fullsized":"2024-04-25T12:50:18.443731+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490742+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:18.490742+0000","last_peered":"2024-04-25T12:50:18.490742+0000","last_clean":"2024-04-25T12:50:18.490742+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:18.490742+0000","last_undegraded":"2024-04-25T12:50:18.490742+0000","last_fullsized":"2024-04-25T12:50:18.490742+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194447+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:19.194447+0000","last_peered":"2024-04-25T12:50:19.194447+0000","last_clean":"2024-04-25T12:50:19.194447+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:19.194447+0000","last_undegraded":"2024-04-25T12:50:19.194447+0000","last_fullsized":"2024-04-25T12:50:19.194447+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193280+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:19.193280+0000","last_peered":"2024-04-25T12:50:19.193280+0000","last_clean":"2024-04-25T12:50:19.193280+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:19.193280+0000","last_undegraded":"2024-04-25T12:50:19.193280+0000","last_fullsized":"2024-04-25T12:50:19.193280+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193177+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:19.193177+0000","last_peered":"2024-04-25T12:50:19.193177+0000","last_clean":"2024-04-25T12:50:19.193177+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:19.193177+0000","last_undegraded":"2024-04-25T12:50:19.193177+0000","last_fullsized":"2024-04-25T12:50:19.193177+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194335+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:19.194335+0000","last_peered":"2024-04-25T12:50:19.194335+0000","last_clean":"2024-04-25T12:50:19.194335+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:19.194335+0000","last_undegraded":"2024-04-25T12:50:19.194335+0000","last_fullsized":"2024-04-25T12:50:19.194335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374456+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:18.374456+0000","last_peered":"2024-04-25T12:50:18.374456+0000","last_clean":"2024-04-25T12:50:18.374456+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:18.374456+0000","last_undegraded":"2024-04-25T12:50:18.374456+0000","last_fullsized":"2024-04-25T12:50:18.374456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.373647+0000","last_change":"2024-04-25T12:50:17.392618+0000","last_active":"2024-04-25T12:50:18.373647+0000","last_peered":"2024-04-25T12:50:18.373647+0000","last_clean":"2024-04-25T12:50:18.373647+0000","last_became_active":"2024-04-25T12:50:17.392252+0000","last_became_peered":"2024-04-25T12:50:17.392252+0000","last_unstale":"2024-04-25T12:50:18.373647+0000","last_undegraded":"2024-04-25T12:50:18.373647+0000","last_fullsized":"2024-04-25T12:50:18.373647+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:21.181630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193639+0000","last_change":"2024-04-25T12:50:13.367452+0000","last_active":"2024-04-25T12:50:19.193639+0000","last_peered":"2024-04-25T12:50:19.193639+0000","last_clean":"2024-04-25T12:50:19.193639+0000","last_became_active":"2024-04-25T12:50:13.367191+0000","last_became_peered":"2024-04-25T12:50:13.367191+0000","last_unstale":"2024-04-25T12:50:19.193639+0000","last_undegraded":"2024-04-25T12:50:19.193639+0000","last_fullsized":"2024-04-25T12:50:19.193639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:20:22.674147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192881+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:19.192881+0000","last_peered":"2024-04-25T12:50:19.192881+0000","last_clean":"2024-04-25T12:50:19.192881+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:19.192881+0000","last_undegraded":"2024-04-25T12:50:19.192881+0000","last_fullsized":"2024-04-25T12:50:19.192881+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490922+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:18.490922+0000","last_peered":"2024-04-25T12:50:18.490922+0000","last_clean":"2024-04-25T12:50:18.490922+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:18.490922+0000","last_undegraded":"2024-04-25T12:50:18.490922+0000","last_fullsized":"2024-04-25T12:50:18.490922+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708208+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:18.708208+0000","last_peered":"2024-04-25T12:50:18.708208+0000","last_clean":"2024-04-25T12:50:18.708208+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:18.708208+0000","last_undegraded":"2024-04-25T12:50:18.708208+0000","last_fullsized":"2024-04-25T12:50:18.708208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708149+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:18.708149+0000","last_peered":"2024-04-25T12:50:18.708149+0000","last_clean":"2024-04-25T12:50:18.708149+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:18.708149+0000","last_undegraded":"2024-04-25T12:50:18.708149+0000","last_fullsized":"2024-04-25T12:50:18.708149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376312+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:18.376312+0000","last_peered":"2024-04-25T12:50:18.376312+0000","last_clean":"2024-04-25T12:50:18.376312+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:18.376312+0000","last_undegraded":"2024-04-25T12:50:18.376312+0000","last_fullsized":"2024-04-25T12:50:18.376312+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194172+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:19.194172+0000","last_peered":"2024-04-25T12:50:19.194172+0000","last_clean":"2024-04-25T12:50:19.194172+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:19.194172+0000","last_undegraded":"2024-04-25T12:50:19.194172+0000","last_fullsized":"2024-04-25T12:50:19.194172+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193812+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:19.193812+0000","last_peered":"2024-04-25T12:50:19.193812+0000","last_clean":"2024-04-25T12:50:19.193812+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:19.193812+0000","last_undegraded":"2024-04-25T12:50:19.193812+0000","last_fullsized":"2024-04-25T12:50:19.193812+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376048+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:18.376048+0000","last_peered":"2024-04-25T12:50:18.376048+0000","last_clean":"2024-04-25T12:50:18.376048+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:18.376048+0000","last_undegraded":"2024-04-25T12:50:18.376048+0000","last_fullsized":"2024-04-25T12:50:18.376048+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490628+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:18.490628+0000","last_peered":"2024-04-25T12:50:18.490628+0000","last_clean":"2024-04-25T12:50:18.490628+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:18.490628+0000","last_undegraded":"2024-04-25T12:50:18.490628+0000","last_fullsized":"2024-04-25T12:50:18.490628+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490899+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:18.490899+0000","last_peered":"2024-04-25T12:50:18.490899+0000","last_clean":"2024-04-25T12:50:18.490899+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:18.490899+0000","last_undegraded":"2024-04-25T12:50:18.490899+0000","last_fullsized":"2024-04-25T12:50:18.490899+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194059+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:19.194059+0000","last_peered":"2024-04-25T12:50:19.194059+0000","last_clean":"2024-04-25T12:50:19.194059+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:19.194059+0000","last_undegraded":"2024-04-25T12:50:19.194059+0000","last_fullsized":"2024-04-25T12:50:19.194059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193830+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:19.193830+0000","last_peered":"2024-04-25T12:50:19.193830+0000","last_clean":"2024-04-25T12:50:19.193830+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:19.193830+0000","last_undegraded":"2024-04-25T12:50:19.193830+0000","last_fullsized":"2024-04-25T12:50:19.193830+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:27.695335+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:27.695335+0000","last_peered":"2024-04-25T12:50:27.695335+0000","last_clean":"2024-04-25T12:50:27.695335+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:27.695335+0000","last_undegraded":"2024-04-25T12:50:27.695335+0000","last_fullsized":"2024-04-25T12:50:27.695335+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443311+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:18.443311+0000","last_peered":"2024-04-25T12:50:18.443311+0000","last_clean":"2024-04-25T12:50:18.443311+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:18.443311+0000","last_undegraded":"2024-04-25T12:50:18.443311+0000","last_fullsized":"2024-04-25T12:50:18.443311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374509+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:18.374509+0000","last_peered":"2024-04-25T12:50:18.374509+0000","last_clean":"2024-04-25T12:50:18.374509+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:18.374509+0000","last_undegraded":"2024-04-25T12:50:18.374509+0000","last_fullsized":"2024-04-25T12:50:18.374509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443678+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:18.443678+0000","last_peered":"2024-04-25T12:50:18.443678+0000","last_clean":"2024-04-25T12:50:18.443678+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:18.443678+0000","last_undegraded":"2024-04-25T12:50:18.443678+0000","last_fullsized":"2024-04-25T12:50:18.443678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374070+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:18.374070+0000","last_peered":"2024-04-25T12:50:18.374070+0000","last_clean":"2024-04-25T12:50:18.374070+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:18.374070+0000","last_undegraded":"2024-04-25T12:50:18.374070+0000","last_fullsized":"2024-04-25T12:50:18.374070+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490802+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:18.490802+0000","last_peered":"2024-04-25T12:50:18.490802+0000","last_clean":"2024-04-25T12:50:18.490802+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:18.490802+0000","last_undegraded":"2024-04-25T12:50:18.490802+0000","last_fullsized":"2024-04-25T12:50:18.490802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194108+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:19.194108+0000","last_peered":"2024-04-25T12:50:19.194108+0000","last_clean":"2024-04-25T12:50:19.194108+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:19.194108+0000","last_undegraded":"2024-04-25T12:50:19.194108+0000","last_fullsized":"2024-04-25T12:50:19.194108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375750+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:18.375750+0000","last_peered":"2024-04-25T12:50:18.375750+0000","last_clean":"2024-04-25T12:50:18.375750+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:18.375750+0000","last_undegraded":"2024-04-25T12:50:18.375750+0000","last_fullsized":"2024-04-25T12:50:18.375750+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194015+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:19.194015+0000","last_peered":"2024-04-25T12:50:19.194015+0000","last_clean":"2024-04-25T12:50:19.194015+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:19.194015+0000","last_undegraded":"2024-04-25T12:50:19.194015+0000","last_fullsized":"2024-04-25T12:50:19.194015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708598+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:18.708598+0000","last_peered":"2024-04-25T12:50:18.708598+0000","last_clean":"2024-04-25T12:50:18.708598+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:18.708598+0000","last_undegraded":"2024-04-25T12:50:18.708598+0000","last_fullsized":"2024-04-25T12:50:18.708598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375629+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:18.375629+0000","last_peered":"2024-04-25T12:50:18.375629+0000","last_clean":"2024-04-25T12:50:18.375629+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:18.375629+0000","last_undegraded":"2024-04-25T12:50:18.375629+0000","last_fullsized":"2024-04-25T12:50:18.375629+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490933+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:18.490933+0000","last_peered":"2024-04-25T12:50:18.490933+0000","last_clean":"2024-04-25T12:50:18.490933+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:18.490933+0000","last_undegraded":"2024-04-25T12:50:18.490933+0000","last_fullsized":"2024-04-25T12:50:18.490933+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443059+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:18.443059+0000","last_peered":"2024-04-25T12:50:18.443059+0000","last_clean":"2024-04-25T12:50:18.443059+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:18.443059+0000","last_undegraded":"2024-04-25T12:50:18.443059+0000","last_fullsized":"2024-04-25T12:50:18.443059+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193400+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:19.193400+0000","last_peered":"2024-04-25T12:50:19.193400+0000","last_clean":"2024-04-25T12:50:19.193400+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:19.193400+0000","last_undegraded":"2024-04-25T12:50:19.193400+0000","last_fullsized":"2024-04-25T12:50:19.193400+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708614+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:18.708614+0000","last_peered":"2024-04-25T12:50:18.708614+0000","last_clean":"2024-04-25T12:50:18.708614+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:18.708614+0000","last_undegraded":"2024-04-25T12:50:18.708614+0000","last_fullsized":"2024-04-25T12:50:18.708614+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375619+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:18.375619+0000","last_peered":"2024-04-25T12:50:18.375619+0000","last_clean":"2024-04-25T12:50:18.375619+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:18.375619+0000","last_undegraded":"2024-04-25T12:50:18.375619+0000","last_fullsized":"2024-04-25T12:50:18.375619+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375790+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:18.375790+0000","last_peered":"2024-04-25T12:50:18.375790+0000","last_clean":"2024-04-25T12:50:18.375790+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:18.375790+0000","last_undegraded":"2024-04-25T12:50:18.375790+0000","last_fullsized":"2024-04-25T12:50:18.375790+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708432+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:18.708432+0000","last_peered":"2024-04-25T12:50:18.708432+0000","last_clean":"2024-04-25T12:50:18.708432+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:18.708432+0000","last_undegraded":"2024-04-25T12:50:18.708432+0000","last_fullsized":"2024-04-25T12:50:18.708432+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490790+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:18.490790+0000","last_peered":"2024-04-25T12:50:18.490790+0000","last_clean":"2024-04-25T12:50:18.490790+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:18.490790+0000","last_undegraded":"2024-04-25T12:50:18.490790+0000","last_fullsized":"2024-04-25T12:50:18.490790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193090+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:19.193090+0000","last_peered":"2024-04-25T12:50:19.193090+0000","last_clean":"2024-04-25T12:50:19.193090+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:19.193090+0000","last_undegraded":"2024-04-25T12:50:19.193090+0000","last_fullsized":"2024-04-25T12:50:19.193090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375880+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:18.375880+0000","last_peered":"2024-04-25T12:50:18.375880+0000","last_clean":"2024-04-25T12:50:18.375880+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:18.375880+0000","last_undegraded":"2024-04-25T12:50:18.375880+0000","last_fullsized":"2024-04-25T12:50:18.375880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374019+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:18.374019+0000","last_peered":"2024-04-25T12:50:18.374019+0000","last_clean":"2024-04-25T12:50:18.374019+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:18.374019+0000","last_undegraded":"2024-04-25T12:50:18.374019+0000","last_fullsized":"2024-04-25T12:50:18.374019+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375974+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:18.375974+0000","last_peered":"2024-04-25T12:50:18.375974+0000","last_clean":"2024-04-25T12:50:18.375974+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:18.375974+0000","last_undegraded":"2024-04-25T12:50:18.375974+0000","last_fullsized":"2024-04-25T12:50:18.375974+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.707993+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:18.707993+0000","last_peered":"2024-04-25T12:50:18.707993+0000","last_clean":"2024-04-25T12:50:18.707993+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:18.707993+0000","last_undegraded":"2024-04-25T12:50:18.707993+0000","last_fullsized":"2024-04-25T12:50:18.707993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.192896+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:19.192896+0000","last_peered":"2024-04-25T12:50:19.192896+0000","last_clean":"2024-04-25T12:50:19.192896+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:19.192896+0000","last_undegraded":"2024-04-25T12:50:19.192896+0000","last_fullsized":"2024-04-25T12:50:19.192896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193566+0000","last_change":"2024-04-25T12:50:13.358445+0000","last_active":"2024-04-25T12:50:19.193566+0000","last_peered":"2024-04-25T12:50:19.193566+0000","last_clean":"2024-04-25T12:50:19.193566+0000","last_became_active":"2024-04-25T12:50:13.358182+0000","last_became_peered":"2024-04-25T12:50:13.358182+0000","last_unstale":"2024-04-25T12:50:19.193566+0000","last_undegraded":"2024-04-25T12:50:19.193566+0000","last_fullsized":"2024-04-25T12:50:19.193566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:32:46.419647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490749+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:18.490749+0000","last_peered":"2024-04-25T12:50:18.490749+0000","last_clean":"2024-04-25T12:50:18.490749+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:18.490749+0000","last_undegraded":"2024-04-25T12:50:18.490749+0000","last_fullsized":"2024-04-25T12:50:18.490749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376132+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:18.376132+0000","last_peered":"2024-04-25T12:50:18.376132+0000","last_clean":"2024-04-25T12:50:18.376132+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:18.376132+0000","last_undegraded":"2024-04-25T12:50:18.376132+0000","last_fullsized":"2024-04-25T12:50:18.376132+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443568+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:18.443568+0000","last_peered":"2024-04-25T12:50:18.443568+0000","last_clean":"2024-04-25T12:50:18.443568+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:18.443568+0000","last_undegraded":"2024-04-25T12:50:18.443568+0000","last_fullsized":"2024-04-25T12:50:18.443568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708601+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:18.708601+0000","last_peered":"2024-04-25T12:50:18.708601+0000","last_clean":"2024-04-25T12:50:18.708601+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:18.708601+0000","last_undegraded":"2024-04-25T12:50:18.708601+0000","last_fullsized":"2024-04-25T12:50:18.708601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.376259+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:18.376259+0000","last_peered":"2024-04-25T12:50:18.376259+0000","last_clean":"2024-04-25T12:50:18.376259+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:18.376259+0000","last_undegraded":"2024-04-25T12:50:18.376259+0000","last_fullsized":"2024-04-25T12:50:18.376259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193289+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:19.193289+0000","last_peered":"2024-04-25T12:50:19.193289+0000","last_clean":"2024-04-25T12:50:19.193289+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:19.193289+0000","last_undegraded":"2024-04-25T12:50:19.193289+0000","last_fullsized":"2024-04-25T12:50:19.193289+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375698+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:18.375698+0000","last_peered":"2024-04-25T12:50:18.375698+0000","last_clean":"2024-04-25T12:50:18.375698+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:18.375698+0000","last_undegraded":"2024-04-25T12:50:18.375698+0000","last_fullsized":"2024-04-25T12:50:18.375698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193540+0000","last_change":"2024-04-25T12:50:13.369544+0000","last_active":"2024-04-25T12:50:19.193540+0000","last_peered":"2024-04-25T12:50:19.193540+0000","last_clean":"2024-04-25T12:50:19.193540+0000","last_became_active":"2024-04-25T12:50:13.369254+0000","last_became_peered":"2024-04-25T12:50:13.369254+0000","last_unstale":"2024-04-25T12:50:19.193540+0000","last_undegraded":"2024-04-25T12:50:19.193540+0000","last_fullsized":"2024-04-25T12:50:19.193540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:07.576394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490531+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:18.490531+0000","last_peered":"2024-04-25T12:50:18.490531+0000","last_clean":"2024-04-25T12:50:18.490531+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:18.490531+0000","last_undegraded":"2024-04-25T12:50:18.490531+0000","last_fullsized":"2024-04-25T12:50:18.490531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708357+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:18.708357+0000","last_peered":"2024-04-25T12:50:18.708357+0000","last_clean":"2024-04-25T12:50:18.708357+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:18.708357+0000","last_undegraded":"2024-04-25T12:50:18.708357+0000","last_fullsized":"2024-04-25T12:50:18.708357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194284+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:19.194284+0000","last_peered":"2024-04-25T12:50:19.194284+0000","last_clean":"2024-04-25T12:50:19.194284+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:19.194284+0000","last_undegraded":"2024-04-25T12:50:19.194284+0000","last_fullsized":"2024-04-25T12:50:19.194284+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193222+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:19.193222+0000","last_peered":"2024-04-25T12:50:19.193222+0000","last_clean":"2024-04-25T12:50:19.193222+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:19.193222+0000","last_undegraded":"2024-04-25T12:50:19.193222+0000","last_fullsized":"2024-04-25T12:50:19.193222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194416+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:19.194416+0000","last_peered":"2024-04-25T12:50:19.194416+0000","last_clean":"2024-04-25T12:50:19.194416+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:19.194416+0000","last_undegraded":"2024-04-25T12:50:19.194416+0000","last_fullsized":"2024-04-25T12:50:19.194416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193130+0000","last_change":"2024-04-25T12:50:13.361730+0000","last_active":"2024-04-25T12:50:19.193130+0000","last_peered":"2024-04-25T12:50:19.193130+0000","last_clean":"2024-04-25T12:50:19.193130+0000","last_became_active":"2024-04-25T12:50:13.361305+0000","last_became_peered":"2024-04-25T12:50:13.361305+0000","last_unstale":"2024-04-25T12:50:19.193130+0000","last_undegraded":"2024-04-25T12:50:19.193130+0000","last_fullsized":"2024-04-25T12:50:19.193130+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:27.112968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443125+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:18.443125+0000","last_peered":"2024-04-25T12:50:18.443125+0000","last_clean":"2024-04-25T12:50:18.443125+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:18.443125+0000","last_undegraded":"2024-04-25T12:50:18.443125+0000","last_fullsized":"2024-04-25T12:50:18.443125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490744+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:18.490744+0000","last_peered":"2024-04-25T12:50:18.490744+0000","last_clean":"2024-04-25T12:50:18.490744+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:18.490744+0000","last_undegraded":"2024-04-25T12:50:18.490744+0000","last_fullsized":"2024-04-25T12:50:18.490744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375678+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:18.375678+0000","last_peered":"2024-04-25T12:50:18.375678+0000","last_clean":"2024-04-25T12:50:18.375678+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:18.375678+0000","last_undegraded":"2024-04-25T12:50:18.375678+0000","last_fullsized":"2024-04-25T12:50:18.375678+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.374421+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:18.374421+0000","last_peered":"2024-04-25T12:50:18.374421+0000","last_clean":"2024-04-25T12:50:18.374421+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:18.374421+0000","last_undegraded":"2024-04-25T12:50:18.374421+0000","last_fullsized":"2024-04-25T12:50:18.374421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708474+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:18.708474+0000","last_peered":"2024-04-25T12:50:18.708474+0000","last_clean":"2024-04-25T12:50:18.708474+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:18.708474+0000","last_undegraded":"2024-04-25T12:50:18.708474+0000","last_fullsized":"2024-04-25T12:50:18.708474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.708530+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:18.708530+0000","last_peered":"2024-04-25T12:50:18.708530+0000","last_clean":"2024-04-25T12:50:18.708530+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:18.708530+0000","last_undegraded":"2024-04-25T12:50:18.708530+0000","last_fullsized":"2024-04-25T12:50:18.708530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194342+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:19.194342+0000","last_peered":"2024-04-25T12:50:19.194342+0000","last_clean":"2024-04-25T12:50:19.194342+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:19.194342+0000","last_undegraded":"2024-04-25T12:50:19.194342+0000","last_fullsized":"2024-04-25T12:50:19.194342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.375421+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:18.375421+0000","last_peered":"2024-04-25T12:50:18.375421+0000","last_clean":"2024-04-25T12:50:18.375421+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:18.375421+0000","last_undegraded":"2024-04-25T12:50:18.375421+0000","last_fullsized":"2024-04-25T12:50:18.375421+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193509+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:19.193509+0000","last_peered":"2024-04-25T12:50:19.193509+0000","last_clean":"2024-04-25T12:50:19.193509+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:19.193509+0000","last_undegraded":"2024-04-25T12:50:19.193509+0000","last_fullsized":"2024-04-25T12:50:19.193509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193428+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:19.193428+0000","last_peered":"2024-04-25T12:50:19.193428+0000","last_clean":"2024-04-25T12:50:19.193428+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:19.193428+0000","last_undegraded":"2024-04-25T12:50:19.193428+0000","last_fullsized":"2024-04-25T12:50:19.193428+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.193961+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:19.193961+0000","last_peered":"2024-04-25T12:50:19.193961+0000","last_clean":"2024-04-25T12:50:19.193961+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:19.193961+0000","last_undegraded":"2024-04-25T12:50:19.193961+0000","last_fullsized":"2024-04-25T12:50:19.193961+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194637+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:19.194637+0000","last_peered":"2024-04-25T12:50:19.194637+0000","last_clean":"2024-04-25T12:50:19.194637+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:19.194637+0000","last_undegraded":"2024-04-25T12:50:19.194637+0000","last_fullsized":"2024-04-25T12:50:19.194637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.490720+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:18.490720+0000","last_peered":"2024-04-25T12:50:18.490720+0000","last_clean":"2024-04-25T12:50:18.490720+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:18.490720+0000","last_undegraded":"2024-04-25T12:50:18.490720+0000","last_fullsized":"2024-04-25T12:50:18.490720+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:18.443835+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:18.443835+0000","last_peered":"2024-04-25T12:50:18.443835+0000","last_clean":"2024-04-25T12:50:18.443835+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:18.443835+0000","last_undegraded":"2024-04-25T12:50:18.443835+0000","last_fullsized":"2024-04-25T12:50:18.443835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-04-25T12:50:19.194154+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:19.194154+0000","last_peered":"2024-04-25T12:50:19.194154+0000","last_clean":"2024-04-25T12:50:19.194154+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:19.194154+0000","last_undegraded":"2024-04-25T12:50:19.194154+0000","last_fullsized":"2024-04-25T12:50:19.194154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":270336,"data_stored":104527,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542156,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":695373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":695317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574860,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":266240,"data_stored":104457,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31452,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340388,"statfs":{"total":96636764160,"available":96604557312,"internally_reserved":0,"allocated":274432,"data_stored":104493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":108209,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":104367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:47.106 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T12:50:47.106 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T12:50:47.106 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T12:50:47.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T12:50:47.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.240+0000 7f1becb19640 1 Processor -- start 2024-04-25T12:50:47.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.240+0000 7f1becb19640 1 -- start start 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1becb19640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1be8151fa0 0x7f1be8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1becb19640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8152380 0x7f1be815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1becb19640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1be80c4cc0 0x7f1be80c8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1becb19640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1be815bae0 con 0x7f1be80c4cc0 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1becb19640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1be815b500 con 0x7f1be8151fa0 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1becb19640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1be80c52f0 con 0x7f1be8152380 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1be80c4cc0 0x7f1be80c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1be80c4cc0 0x7f1be80c8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51694/0 (socket says 172.21.15.132:51694) 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 -- 172.21.15.132:0/1627551943 learned_addr learned my addr 172.21.15.132:0/1627551943 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:47.241 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be659c640 1 --2- 172.21.15.132:0/1627551943 >> v2:172.21.15.157:3300/0 conn(0x7f1be8151fa0 0x7f1be8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1bdffff640 1 --2- 172.21.15.132:0/1627551943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8152380 0x7f1be815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 -- 172.21.15.132:0/1627551943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8152380 msgr2=0x7f1be815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 --2- 172.21.15.132:0/1627551943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8152380 0x7f1be815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 -- 172.21.15.132:0/1627551943 >> v2:172.21.15.157:3300/0 conn(0x7f1be8151fa0 msgr2=0x7f1be8157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 --2- 172.21.15.132:0/1627551943 >> v2:172.21.15.157:3300/0 conn(0x7f1be8151fa0 0x7f1be8157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.241+0000 7f1be6d9d640 1 -- 172.21.15.132:0/1627551943 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be80c55d0 con 0x7f1be80c4cc0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1be6d9d640 1 --2- 172.21.15.132:0/1627551943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be80c8940 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1be806f660 tx=0x7f1be002a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2209aececb77789 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1be5d9b640 1 -- 172.21.15.132:0/1627551943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be0036070 con 0x7f1be80c4cc0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1be5d9b640 1 -- 172.21.15.132:0/1627551943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1be0031600 con 0x7f1be80c4cc0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1be5d9b640 1 -- 172.21.15.132:0/1627551943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1be00319d0 con 0x7f1be80c4cc0 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 -- 172.21.15.132:0/1627551943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 msgr2=0x7f1be80c8940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 --2- 172.21.15.132:0/1627551943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be80c8940 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f1be806f660 tx=0x7f1be002a6a0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 -- 172.21.15.132:0/1627551943 shutdown_connections 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 --2- 172.21.15.132:0/1627551943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be80c8940 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 --2- 172.21.15.132:0/1627551943 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8152380 0x7f1be815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 --2- 172.21.15.132:0/1627551943 >> v2:172.21.15.157:3300/0 conn(0x7f1be8151fa0 0x7f1be8157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.242+0000 7f1becb19640 1 -- 172.21.15.132:0/1627551943 >> 172.21.15.132:0/1627551943 conn(0x7f1be8067630 msgr2=0x7f1be8067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.243+0000 7f1becb19640 1 -- 172.21.15.132:0/1627551943 shutdown_connections 2024-04-25T12:50:47.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.243+0000 7f1becb19640 1 -- 172.21.15.132:0/1627551943 wait complete. 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 Processor -- start 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 -- start start 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be814ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8151fa0 0x7f1be8147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be8152380 0x7f1be8147cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1be80c58b0 con 0x7f1be80c4cc0 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1be80c8e80 con 0x7f1be8152380 2024-04-25T12:50:47.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.244+0000 7f1becb19640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1be80c3bc0 con 0x7f1be8151fa0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be814ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be814ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51708/0 (socket says 172.21.15.132:51708) 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 -- 172.21.15.132:0/2030633749 learned_addr learned my addr 172.21.15.132:0/2030633749 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be6d9d640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be8152380 0x7f1be8147cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1bdffff640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8151fa0 0x7f1be8147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 -- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8151fa0 msgr2=0x7f1be8147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8151fa0 0x7f1be8147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 -- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be8152380 msgr2=0x7f1be8147cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be8152380 0x7f1be8147cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 -- 172.21.15.132:0/2030633749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1be81f4e50 con 0x7f1be80c4cc0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be6d9d640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be8152380 0x7f1be8147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1be659c640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be814ebe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800d800 tx=0x7f1bd800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8018020 con 0x7f1be80c4cc0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bd8009640 con 0x7f1be80c4cc0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bd8009a10 con 0x7f1be80c4cc0 2024-04-25T12:50:47.247 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1be81f5130 con 0x7f1be80c4cc0 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.245+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1be8156440 con 0x7f1be80c4cc0 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.246+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1be8068c20 con 0x7f1be80c4cc0 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.247+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1bd801b020 con 0x7f1be80c4cc0 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.247+0000 7f1bdeffd640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1bc806c8f0 0x7f1bc806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.247+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1bd808c340 con 0x7f1be80c4cc0 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.247+0000 7f1bdffff640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1bc806c8f0 0x7f1bc806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.248 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.247+0000 7f1bdffff640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1bc806c8f0 0x7f1bc806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0006fd0 tx=0x7f1bd0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.251+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1bd8022020 con 0x7f1be80c4cc0 2024-04-25T12:50:47.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.463+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f1be8155bc0 con 0x7f1be80c4cc0 2024-04-25T12:50:47.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.464+0000 7f1bdeffd640 1 -- 172.21.15.132:0/2030633749 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f1bd8011340 con 0x7f1be80c4cc0 2024-04-25T12:50:47.462 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:47.462 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T12:50:47.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1bc806c8f0 msgr2=0x7f1bc806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1bc806c8f0 0x7f1bc806edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0006fd0 tx=0x7f1bd0008040 comp rx=0 tx=0).stop 2024-04-25T12:50:47.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 msgr2=0x7f1be814ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be814ebe0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1bd800d800 tx=0x7f1bd800dcc0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.464 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 shutdown_connections 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1bc806c8f0 0x7f1bc806edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1be8152380 0x7f1be8147cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1be8151fa0 0x7f1be8147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 --2- 172.21.15.132:0/2030633749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be80c4cc0 0x7f1be814ebe0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 >> 172.21.15.132:0/2030633749 conn(0x7f1be8067630 msgr2=0x7f1be80c75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 shutdown_connections 2024-04-25T12:50:47.465 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.466+0000 7f1becb19640 1 -- 172.21.15.132:0/2030633749 wait complete. 2024-04-25T12:50:47.475 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T12:50:47.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:47.571 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.573+0000 7f3c29872640 1 Processor -- start 2024-04-25T12:50:47.572 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.573+0000 7f3c29872640 1 -- start start 2024-04-25T12:50:47.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.574+0000 7f3c29872640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 0x7f3c24072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.574+0000 7f3c29872640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c24072bc0 con 0x7f3c240c8690 2024-04-25T12:50:47.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.574+0000 7f3c29872640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c241580a0 con 0x7f3c24152490 2024-04-25T12:50:47.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.574+0000 7f3c29872640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24152870 con 0x7f3c240721f0 2024-04-25T12:50:47.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.574+0000 7f3c227fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3c240c8690 0x7f3c240c8ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37030/0 (socket says 172.21.15.132:37030) 2024-04-25T12:50:47.575 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.574+0000 7f3c227fc640 1 -- 172.21.15.132:0/588173763 learned_addr learned my addr 172.21.15.132:0/588173763 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824579555 0 0) 0x7f3c24072bc0 con 0x7f3c240c8690 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c0c003520 con 0x7f3c240c8690 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c237fe640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 0x7f3c24072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1557644496 0 0) 0x7f3c0c003520 con 0x7f3c240c8690 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 msgr2=0x7f3c24072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 0x7f3c24072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 >> v1:172.21.15.157:6789/0 conn(0x7f3c24152490 legacy=0x7f3c240ca120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c24158340 con 0x7f3c240c8690 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f3c18001670 con 0x7f3c240c8690 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 >> v1:172.21.15.132:6789/0 conn(0x7f3c240c8690 legacy=0x7f3c240c8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 0x7f3c0c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c0c004d40 0x7f3c0c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.576 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24152870 con 0x7f3c0c0039e0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3c0c00b9c0 con 0x7f3c0c004d40 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c0c00bbc0 con 0x7f3c240721f0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c227fc640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 0x7f3c0c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c237fe640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c0c004d40 0x7f3c0c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c22ffd640 1 -- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 msgr2=0x7f3c0c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c240721f0 0x7f3c0c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c22ffd640 1 -- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c0c004d40 msgr2=0x7f3c0c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c0c004d40 0x7f3c0c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.575+0000 7f3c22ffd640 1 -- 172.21.15.132:0/588173763 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c0c003520 con 0x7f3c0c0039e0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.576+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c14001f60 tx=0x7f3c0c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ed4bd44e676b29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.577 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.576+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14037070 con 0x7f3c0c0039e0 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.576+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c14032440 con 0x7f3c0c0039e0 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.576+0000 7f3c21ffb640 1 -- 172.21.15.132:0/588173763 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c14001b30 con 0x7f3c0c0039e0 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c29872640 1 -- 172.21.15.132:0/588173763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c0c0039e0 msgr2=0x7f3c0c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c29872640 1 --2- 172.21.15.132:0/588173763 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c0c0039e0 0x7f3c0c003dc0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3c14001f60 tx=0x7f3c0c005830 comp rx=0 tx=0).stop 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c237fe640 1 -- 172.21.15.132:0/588173763 reap_dead start 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c29872640 1 -- 172.21.15.132:0/588173763 shutdown_connections 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c29872640 1 -- 172.21.15.132:0/588173763 >> 172.21.15.132:0/588173763 conn(0x7f3c2406b930 msgr2=0x7f3c2406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c29872640 1 -- 172.21.15.132:0/588173763 shutdown_connections 2024-04-25T12:50:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.577+0000 7f3c29872640 1 -- 172.21.15.132:0/588173763 wait complete. 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.578+0000 7f3c29872640 1 Processor -- start 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.578+0000 7f3c29872640 1 -- start start 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c0c0039e0 0x7f3c240678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 0x7f3c24154790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c24068250 0x7f3c24154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24158be0 con 0x7f3c240c3c90 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3c24158900 con 0x7f3c24068250 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3c24158ec0 con 0x7f3c0c0039e0 2024-04-25T12:50:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 0x7f3c24154790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 0x7f3c24154790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51726/0 (socket says 172.21.15.132:51726) 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 -- 172.21.15.132:0/2452913586 learned_addr learned my addr 172.21.15.132:0/2452913586 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c237fe640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c24068250 0x7f3c24154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c0c0039e0 0x7f3c240678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 -- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c0c0039e0 msgr2=0x7f3c240678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c0c0039e0 0x7f3c240678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 -- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c24068250 msgr2=0x7f3c24154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c24068250 0x7f3c24154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 -- 172.21.15.132:0/2452913586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c240c5cc0 con 0x7f3c240c3c90 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c227fc640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 0x7f3c24154790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3c180072f0 tx=0x7f3c180077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c18001670 con 0x7f3c240c3c90 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c18018070 con 0x7f3c240c3c90 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c2414c6a0 con 0x7f3c240c3c90 2024-04-25T12:50:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c1800fc00 con 0x7f3c240c3c90 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.579+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c2414cc60 con 0x7f3c240c3c90 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.580+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c240741e0 con 0x7f3c240c3c90 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.581+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3c1801d460 con 0x7f3c240c3c90 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.581+0000 7f3c0bfff640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3c1006c8f0 0x7f3c1006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.581+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f3c1808bfb0 con 0x7f3c240c3c90 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.581+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3c1006c8f0 0x7f3c1006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.582+0000 7f3c22ffd640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3c1006c8f0 0x7f3c1006edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c14034000 tx=0x7f3c14009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.583 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.585+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3c1805a010 con 0x7f3c240c3c90 2024-04-25T12:50:47.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.762+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c2414ce60 con 0x7f3c240c3c90 2024-04-25T12:50:47.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.763+0000 7f3c0bfff640 1 -- 172.21.15.132:0/2452913586 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f3c18059910 con 0x7f3c240c3c90 2024-04-25T12:50:47.762 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:47.762 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3c1006c8f0 msgr2=0x7f3c1006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3c1006c8f0 0x7f3c1006edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3c14034000 tx=0x7f3c14009030 comp rx=0 tx=0).stop 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 msgr2=0x7f3c24154790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 0x7f3c24154790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3c180072f0 tx=0x7f3c180077b0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 shutdown_connections 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3c1006c8f0 0x7f3c1006edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3c24068250 0x7f3c24154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c240c3c90 0x7f3c24154790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 --2- 172.21.15.132:0/2452913586 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3c0c0039e0 0x7f3c240678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 >> 172.21.15.132:0/2452913586 conn(0x7f3c2406b930 msgr2=0x7f3c241572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 shutdown_connections 2024-04-25T12:50:47.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.765+0000 7f3c29872640 1 -- 172.21.15.132:0/2452913586 wait complete. 2024-04-25T12:50:47.775 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:50:11.154024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:50:11.639000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:50:15.365379+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:50:47.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.877+0000 7f83d122a640 1 Processor -- start 2024-04-25T12:50:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.877+0000 7f83d122a640 1 -- start start 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83d122a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc067c80 0x7f83cc0cb530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83d122a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc15ea10 con 0x7f83cc0678a0 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83d122a640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83cc15ecf0 con 0x7f83cc0c7990 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83d122a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc15efd0 con 0x7f83cc067c80 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83cad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f83cc0678a0 0x7f83cc0c7280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37034/0 (socket says 172.21.15.132:37034) 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83cad9d640 1 -- 172.21.15.132:0/1332903957 learned_addr learned my addr 172.21.15.132:0/1332903957 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.878+0000 7f83cb59e640 1 --2- 172.21.15.132:0/1332903957 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc067c80 0x7f83cc0cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.877 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498446972 0 0) 0x7f83cc15ea10 con 0x7f83cc0678a0 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83b8003520 con 0x7f83cc0678a0 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126024302 0 0) 0x7f83cc15ecf0 con 0x7f83cc0c7990 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83cc15ea10 con 0x7f83cc0c7990 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1270116048 0 0) 0x7f83b8003520 con 0x7f83cc0678a0 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83cb59e640 1 -- 172.21.15.132:0/1332903957 >> v1:172.21.15.157:6789/0 conn(0x7f83cc0c7990 legacy=0x7f83cc15cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83cb59e640 1 -- 172.21.15.132:0/1332903957 >> v1:172.21.15.132:6789/0 conn(0x7f83cc0678a0 legacy=0x7f83cc0c7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.878 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.879+0000 7f83cb59e640 1 -- 172.21.15.132:0/1332903957 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc15f2b0 con 0x7f83cc067c80 2024-04-25T12:50:47.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83cb59e640 1 --2- 172.21.15.132:0/1332903957 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc067c80 0x7f83cc0cb530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83c40097d0 tx=0x7f83c402a230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41ee1cc6678eed75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83c4037070 con 0x7f83cc067c80 2024-04-25T12:50:47.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83c402acc0 con 0x7f83cc067c80 2024-04-25T12:50:47.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83c9d9b640 1 -- 172.21.15.132:0/1332903957 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc001a10 con 0x7f83cc067c80 2024-04-25T12:50:47.883 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 -- 172.21.15.132:0/1332903957 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc067c80 msgr2=0x7f83cc0cb530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 --2- 172.21.15.132:0/1332903957 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc067c80 0x7f83cc0cb530 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f83c40097d0 tx=0x7f83c402a230 comp rx=0 tx=0).stop 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 -- 172.21.15.132:0/1332903957 shutdown_connections 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 --2- 172.21.15.132:0/1332903957 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc067c80 0x7f83cc0cb530 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 -- 172.21.15.132:0/1332903957 >> 172.21.15.132:0/1332903957 conn(0x7f83cc06b930 msgr2=0x7f83cc06bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 -- 172.21.15.132:0/1332903957 shutdown_connections 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.880+0000 7f83d122a640 1 -- 172.21.15.132:0/1332903957 wait complete. 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 Processor -- start 2024-04-25T12:50:47.884 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 -- start start 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 0x7f83cc1e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83cc067c80 0x7f83cc1e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc0c7990 0x7f83cc155ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc15d260 con 0x7f83cc0678a0 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f83cc0c8370 con 0x7f83cc067c80 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.882+0000 7f83d122a640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f83cc15d3e0 con 0x7f83cc0c7990 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 0x7f83cc1e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 0x7f83cc1e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51732/0 (socket says 172.21.15.132:51732) 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 -- 172.21.15.132:0/2899935688 learned_addr learned my addr 172.21.15.132:0/2899935688 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cb59e640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc0c7990 0x7f83cc155ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83ca59c640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83cc067c80 0x7f83cc1e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 -- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc0c7990 msgr2=0x7f83cc155ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc0c7990 0x7f83cc155ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.885 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 -- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83cc067c80 msgr2=0x7f83cc1e67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83cc067c80 0x7f83cc1e67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 -- 172.21.15.132:0/2899935688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83cc1f0cb0 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83ca59c640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83cc067c80 0x7f83cc1e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83cad9d640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 0x7f83cc1e6260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83bc001580 tx=0x7f83bc00ce90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc018070 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83bc00a6a0 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83cc15e200 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83bc00aa90 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.883+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83cc1f0f70 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.884+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83cc0741e0 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.885+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f83bc01b070 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.885+0000 7f83c37fe640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f83ac06c920 0x7f83ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.885+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f83bc08b5a0 con 0x7f83cc0678a0 2024-04-25T12:50:47.886 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.885+0000 7f83ca59c640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f83ac06c920 0x7f83ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:47.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.886+0000 7f83ca59c640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f83ac06c920 0x7f83ac06ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0cae90 tx=0x7f83b4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:47.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:47.889+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f83bc059690 con 0x7f83cc0678a0 2024-04-25T12:50:48.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.063+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f83cc15c600 con 0x7f83cc0678a0 2024-04-25T12:50:48.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.063+0000 7f83c37fe640 1 -- 172.21.15.132:0/2899935688 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f83bc058f90 con 0x7f83cc0678a0 2024-04-25T12:50:48.062 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:48.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f83ac06c920 msgr2=0x7f83ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f83ac06c920 0x7f83ac06ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f83cc0cae90 tx=0x7f83b4009040 comp rx=0 tx=0).stop 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 msgr2=0x7f83cc1e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 0x7f83cc1e6260 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f83bc001580 tx=0x7f83bc00ce90 comp rx=0 tx=0).stop 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 shutdown_connections 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f83ac06c920 0x7f83ac06ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f83cc0c7990 0x7f83cc155ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f83cc067c80 0x7f83cc1e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 --2- 172.21.15.132:0/2899935688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83cc0678a0 0x7f83cc1e6260 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 >> 172.21.15.132:0/2899935688 conn(0x7f83cc06b930 msgr2=0x7f83cc0c7280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 shutdown_connections 2024-04-25T12:50:48.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.065+0000 7f83d122a640 1 -- 172.21.15.132:0/2899935688 wait complete. 2024-04-25T12:50:48.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:50:48.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.177+0000 7f0cc587c640 1 Processor -- start 2024-04-25T12:50:48.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.177+0000 7f0cc587c640 1 -- start start 2024-04-25T12:50:48.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cc587c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc0155530 0x7f0cc00cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cc587c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 0x7f0cc015eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cc587c640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0cc015f430 con 0x7f0cc00cc230 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cc587c640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f0cc015b2e0 con 0x7f0cc015ea60 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cc587c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc015b580 con 0x7f0cc0155530 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbf7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 0x7f0cc015eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbeffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc0155530 0x7f0cc00cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbf7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 0x7f0cc015eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:40020/0 (socket says 172.21.15.132:40020) 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbe7fc640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f0cc00cc230 0x7f0cc0072b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60880/0 (socket says 172.21.15.132:60880) 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbf7fe640 1 -- 172.21.15.132:0/2577546471 learned_addr learned my addr 172.21.15.132:0/2577546471 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbeffd640 1 -- 172.21.15.132:0/2577546471 >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 msgr2=0x7f0cc015eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbeffd640 1 --2- 172.21.15.132:0/2577546471 >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 0x7f0cc015eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.178+0000 7f0cbeffd640 1 -- 172.21.15.132:0/2577546471 >> v1:172.21.15.157:6789/0 conn(0x7f0cc00cc230 legacy=0x7f0cc0072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.179+0000 7f0cbeffd640 1 -- 172.21.15.132:0/2577546471 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc015b860 con 0x7f0cc0155530 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.179+0000 7f0cbf7fe640 1 --2- 172.21.15.132:0/2577546471 >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 0x7f0cc015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.179+0000 7f0cbeffd640 1 --2- 172.21.15.132:0/2577546471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc0155530 0x7f0cc00cb310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009d90 tx=0x7f0cb002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b436cec923ab6725 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.178 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.179+0000 7f0cbdffb640 1 -- 172.21.15.132:0/2577546471 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0007740 con 0x7f0cc0155530 2024-04-25T12:50:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.179+0000 7f0cbdffb640 1 -- 172.21.15.132:0/2577546471 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb00078e0 con 0x7f0cc0155530 2024-04-25T12:50:48.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.179+0000 7f0cbdffb640 1 -- 172.21.15.132:0/2577546471 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb0007cb0 con 0x7f0cc0155530 2024-04-25T12:50:48.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 -- 172.21.15.132:0/2577546471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc0155530 msgr2=0x7f0cc00cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2577546471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc0155530 0x7f0cc00cb310 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0009d90 tx=0x7f0cb002a6f0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 -- 172.21.15.132:0/2577546471 shutdown_connections 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2577546471 >> v2:172.21.15.157:3300/0 conn(0x7f0cc015ea60 0x7f0cc015eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2577546471 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc0155530 0x7f0cc00cb310 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 -- 172.21.15.132:0/2577546471 >> 172.21.15.132:0/2577546471 conn(0x7f0cc0075d50 msgr2=0x7f0cc006ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 -- 172.21.15.132:0/2577546471 shutdown_connections 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.180+0000 7f0cc587c640 1 -- 172.21.15.132:0/2577546471 wait complete. 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.181+0000 7f0cc587c640 1 Processor -- start 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.181+0000 7f0cc587c640 1 -- start start 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cc587c640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cc00cc230 0x7f0cc00cfa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cc587c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 0x7f0cc00d0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cc587c640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc015ea60 0x7f0cc01e6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cc587c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc00cb850 con 0x7f0cc0155530 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cc587c640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f0cc015be20 con 0x7f0cc00cc230 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cc587c640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f0cc00ce2b0 con 0x7f0cc015ea60 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 0x7f0cc00d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 0x7f0cc00d0440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51746/0 (socket says 172.21.15.132:51746) 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 -- 172.21.15.132:0/2537069889 learned_addr learned my addr 172.21.15.132:0/2537069889 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbeffd640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cc00cc230 0x7f0cc00cfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbf7fe640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc015ea60 0x7f0cc01e6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 -- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc015ea60 msgr2=0x7f0cc01e6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc015ea60 0x7f0cc01e6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 -- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cc00cc230 msgr2=0x7f0cc00cfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cc00cc230 0x7f0cc00cfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.182+0000 7f0cbe7fc640 1 -- 172.21.15.132:0/2537069889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cc00ce930 con 0x7f0cc0155530 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.183+0000 7f0cbe7fc640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 0x7f0cc00d0440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c3e0 tx=0x7f0cb400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.183+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40074e0 con 0x7f0cc0155530 2024-04-25T12:50:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.183+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0cb4007680 con 0x7f0cc0155530 2024-04-25T12:50:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.183+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cc00cebd0 con 0x7f0cc0155530 2024-04-25T12:50:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.183+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cb40049e0 con 0x7f0cc0155530 2024-04-25T12:50:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.183+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cc01f1180 con 0x7f0cc0155530 2024-04-25T12:50:48.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.184+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cc01f0c90 con 0x7f0cc0155530 2024-04-25T12:50:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.184+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0cb401a020 con 0x7f0cc0155530 2024-04-25T12:50:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.185+0000 7f0ca7fff640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0cac06c8f0 0x7f0cac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.185+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0cb408b680 con 0x7f0cc0155530 2024-04-25T12:50:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.185+0000 7f0cbeffd640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0cac06c8f0 0x7f0cac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.185 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.185+0000 7f0cbeffd640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0cac06c8f0 0x7f0cac06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0034000 tx=0x7f0cb002f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.187 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.189+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0cb4059770 con 0x7f0cc0155530 2024-04-25T12:50:48.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.364+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f0cc0068d00 con 0x7f0cc0155530 2024-04-25T12:50:48.362 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.364+0000 7f0ca7fff640 1 -- 172.21.15.132:0/2537069889 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f0cb4059070 con 0x7f0cc0155530 2024-04-25T12:50:48.363 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0cac06c8f0 msgr2=0x7f0cac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0cac06c8f0 0x7f0cac06edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0cb0034000 tx=0x7f0cb002f000 comp rx=0 tx=0).stop 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 msgr2=0x7f0cc00d0440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 0x7f0cc00d0440 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0cb400c3e0 tx=0x7f0cb400c8a0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 shutdown_connections 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f0cac06c8f0 0x7f0cac06edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f0cc015ea60 0x7f0cc01e6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cc0155530 0x7f0cc00d0440 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.365 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 --2- 172.21.15.132:0/2537069889 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f0cc00cc230 0x7f0cc00cfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.366+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 >> 172.21.15.132:0/2537069889 conn(0x7f0cc0075d50 msgr2=0x7f0cc01594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.367+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 shutdown_connections 2024-04-25T12:50:48.366 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.367+0000 7f0cc587c640 1 -- 172.21.15.132:0/2537069889 wait complete. 2024-04-25T12:50:48.376 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:50:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 Processor -- start 2024-04-25T12:50:48.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 -- start start 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf68144550 0x7fcf680cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcf6815e920 0x7fcf6815bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf6815c050 0x7fcf68072ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fcf680c9cd0 con 0x7fcf68144550 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcf6815b330 con 0x7fcf6815e920 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6eb22640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6815ee10 con 0x7fcf6815c050 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.479+0000 7fcf6c8be640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf68144550 0x7fcf680cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf68144550 0x7fcf680cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51756/0 (socket says 172.21.15.132:51756) 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 -- 172.21.15.132:0/3326147249 learned_addr learned my addr 172.21.15.132:0/3326147249 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:48.479 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf67fff640 1 --2- 172.21.15.132:0/3326147249 >> v2:172.21.15.157:3300/0 conn(0x7fcf6815e920 0x7fcf6815bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6d0bf640 1 --2- 172.21.15.132:0/3326147249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf6815c050 0x7fcf68072ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 -- 172.21.15.132:0/3326147249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf6815c050 msgr2=0x7fcf68072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 --2- 172.21.15.132:0/3326147249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf6815c050 0x7fcf68072ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 -- 172.21.15.132:0/3326147249 >> v2:172.21.15.157:3300/0 conn(0x7fcf6815e920 msgr2=0x7fcf6815bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 --2- 172.21.15.132:0/3326147249 >> v2:172.21.15.157:3300/0 conn(0x7fcf6815e920 0x7fcf6815bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 -- 172.21.15.132:0/3326147249 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf6815f0f0 con 0x7fcf68144550 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.480+0000 7fcf6c8be640 1 --2- 172.21.15.132:0/3326147249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf68144550 0x7fcf680cba40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806daf0 tx=0x7fcf5c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78b573ce3eb7e941 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf677fe640 1 -- 172.21.15.132:0/3326147249 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c037070 con 0x7fcf68144550 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf677fe640 1 -- 172.21.15.132:0/3326147249 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf5c032440 con 0x7fcf68144550 2024-04-25T12:50:48.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf677fe640 1 -- 172.21.15.132:0/3326147249 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c032810 con 0x7fcf68144550 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 -- 172.21.15.132:0/3326147249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf68144550 msgr2=0x7fcf680cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/3326147249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf68144550 0x7fcf680cba40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fcf6806daf0 tx=0x7fcf5c02a1e0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 -- 172.21.15.132:0/3326147249 shutdown_connections 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/3326147249 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf6815c050 0x7fcf68072ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/3326147249 >> v2:172.21.15.157:3300/0 conn(0x7fcf6815e920 0x7fcf6815bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/3326147249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf68144550 0x7fcf680cba40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 -- 172.21.15.132:0/3326147249 >> 172.21.15.132:0/3326147249 conn(0x7fcf68070a90 msgr2=0x7fcf68070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 -- 172.21.15.132:0/3326147249 shutdown_connections 2024-04-25T12:50:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.481+0000 7fcf6eb22640 1 -- 172.21.15.132:0/3326147249 wait complete. 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.482+0000 7fcf6eb22640 1 Processor -- start 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.482+0000 7fcf6eb22640 1 -- start start 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6eb22640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf68144550 0x7fcf6813fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6eb22640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6815c050 0x7fcf681e58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6eb22640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 0x7fcf68140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6eb22640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6815b5f0 con 0x7fcf6815e920 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6eb22640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcf6815f6b0 con 0x7fcf6815c050 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6eb22640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcf6806c5f0 con 0x7fcf68144550 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6d0bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 0x7fcf68140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6d0bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 0x7fcf68140800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51762/0 (socket says 172.21.15.132:51762) 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf6d0bf640 1 -- 172.21.15.132:0/938686303 learned_addr learned my addr 172.21.15.132:0/938686303 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.483+0000 7fcf67fff640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6815c050 0x7fcf681e58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6c8be640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf68144550 0x7fcf6813fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6d0bf640 1 -- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf68144550 msgr2=0x7fcf6813fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6d0bf640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf68144550 0x7fcf6813fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6d0bf640 1 -- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6815c050 msgr2=0x7fcf681e58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6d0bf640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6815c050 0x7fcf681e58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6d0bf640 1 -- 172.21.15.132:0/938686303 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf681f1ad0 con 0x7fcf6815e920 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf67fff640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6815c050 0x7fcf681e58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6d0bf640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 0x7fcf68140800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ef00 tx=0x7fcf6000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf60018020 con 0x7fcf6815e920 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf60014400 con 0x7fcf6815e920 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf681f1d70 con 0x7fcf6815e920 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf600147f0 con 0x7fcf6815e920 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.484+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf6813e7a0 con 0x7fcf6815e920 2024-04-25T12:50:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.485+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf68068d00 con 0x7fcf6815e920 2024-04-25T12:50:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.485+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcf60005d10 con 0x7fcf6815e920 2024-04-25T12:50:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.486+0000 7fcf657fa640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcf4c06c8f0 0x7fcf4c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.486+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcf6008c7d0 con 0x7fcf6815e920 2024-04-25T12:50:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.486+0000 7fcf6c8be640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcf4c06c8f0 0x7fcf4c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.486+0000 7fcf6c8be640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcf4c06c8f0 0x7fcf4c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c034000 tx=0x7fcf5c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.490+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcf60022030 con 0x7fcf6815e920 2024-04-25T12:50:48.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.666+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcf680c9330 con 0x7fcf6815e920 2024-04-25T12:50:48.665 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.667+0000 7fcf657fa640 1 -- 172.21.15.132:0/938686303 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7fcf6005a950 con 0x7fcf6815e920 2024-04-25T12:50:48.665 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.668+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcf4c06c8f0 msgr2=0x7fcf4c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.668+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcf4c06c8f0 0x7fcf4c06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c034000 tx=0x7fcf5c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 msgr2=0x7fcf68140800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 0x7fcf68140800 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcf6000ef00 tx=0x7fcf6000b480 comp rx=0 tx=0).stop 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 shutdown_connections 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcf4c06c8f0 0x7fcf4c06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.667 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6815e920 0x7fcf68140800 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcf6815c050 0x7fcf681e58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 --2- 172.21.15.132:0/938686303 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcf68144550 0x7fcf6813fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 >> 172.21.15.132:0/938686303 conn(0x7fcf68070a90 msgr2=0x7fcf6815d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 shutdown_connections 2024-04-25T12:50:48.668 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.669+0000 7fcf6eb22640 1 -- 172.21.15.132:0/938686303 wait complete. 2024-04-25T12:50:48.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:50:48.777 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.779+0000 7f25d4708640 1 Processor -- start 2024-04-25T12:50:48.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.779+0000 7f25d4708640 1 -- start start 2024-04-25T12:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.780+0000 7f25d4708640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f25cc15b2d0 0x7f25cc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.780+0000 7f25d4708640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25cc0c8920 con 0x7f25cc0c7c00 2024-04-25T12:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.780+0000 7f25d4708640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25cc140630 con 0x7f25cc0c7250 2024-04-25T12:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.780+0000 7f25d4708640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f25cc140910 con 0x7f25cc15b2d0 2024-04-25T12:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.780+0000 7f25d2ca5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f25cc0c7c00 0x7f25cc0c8030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37050/0 (socket says 172.21.15.132:37050) 2024-04-25T12:50:48.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.780+0000 7f25d2ca5640 1 -- 172.21.15.132:0/3191515829 learned_addr learned my addr 172.21.15.132:0/3191515829 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d1ca3640 1 --2- 172.21.15.132:0/3191515829 >> v2:172.21.15.157:3300/0 conn(0x7f25cc15b2d0 0x7f25cc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258689132 0 0) 0x7f25cc0c8920 con 0x7f25cc0c7c00 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25b8003520 con 0x7f25cc0c7c00 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 712860730 0 0) 0x7f25b8003520 con 0x7f25cc0c7c00 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 >> v2:172.21.15.157:3300/0 conn(0x7f25cc15b2d0 msgr2=0x7f25cc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 --2- 172.21.15.132:0/3191515829 >> v2:172.21.15.157:3300/0 conn(0x7f25cc15b2d0 0x7f25cc15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 >> v1:172.21.15.157:6789/0 conn(0x7f25cc0c7250 legacy=0x7f25cc06b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc140bf0 con 0x7f25cc0c7c00 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f25c4001670 con 0x7f25cc0c7c00 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 >> v1:172.21.15.132:6789/0 conn(0x7f25cc0c7c00 legacy=0x7f25cc0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b8004800 0x7f25b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b80051c0 0x7f25b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc140910 con 0x7f25b80039b0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25b800c070 con 0x7f25b8004800 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25b800c270 con 0x7f25b80051c0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d24a4640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d1ca3640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b8004800 0x7f25b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d2ca5640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b80051c0 0x7f25b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d24a4640 1 -- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b80051c0 msgr2=0x7f25b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d24a4640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25b80051c0 0x7f25b800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d24a4640 1 -- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b8004800 msgr2=0x7f25b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d24a4640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25b8004800 0x7f25b8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d24a4640 1 -- 172.21.15.132:0/3191515829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25b8003520 con 0x7f25b80039b0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.781+0000 7f25d2ca5640 1 -- 172.21.15.132:0/3191515829 reap_dead start 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.782+0000 7f25d24a4640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25c8001e50 tx=0x7f25b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c65427b264a6eb60 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.782+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8001a70 con 0x7f25b80039b0 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.782+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c802ae40 con 0x7f25b80039b0 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.782+0000 7f25d14a2640 1 -- 172.21.15.132:0/3191515829 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8003bb0 con 0x7f25b80039b0 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 -- 172.21.15.132:0/3191515829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 msgr2=0x7f25b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f25c8001e50 tx=0x7f25b8005830 comp rx=0 tx=0).stop 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 -- 172.21.15.132:0/3191515829 shutdown_connections 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 --2- 172.21.15.132:0/3191515829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25b8003dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 -- 172.21.15.132:0/3191515829 >> 172.21.15.132:0/3191515829 conn(0x7f25cc067a50 msgr2=0x7f25cc06d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 -- 172.21.15.132:0/3191515829 shutdown_connections 2024-04-25T12:50:48.784 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.783+0000 7f25d4708640 1 -- 172.21.15.132:0/3191515829 wait complete. 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.784+0000 7f25d4708640 1 Processor -- start 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.784+0000 7f25d4708640 1 -- start start 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25cc1f5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25cc0cb770 0x7f25cc137d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25cc0cd4d0 0x7f25cc0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0717c0 con 0x7f25b80039b0 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f25cc0c7630 con 0x7f25cc0cd4d0 2024-04-25T12:50:48.787 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f25cc071940 con 0x7f25cc0cb770 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25cc1f5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25cc1f5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51778/0 (socket says 172.21.15.132:51778) 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 -- 172.21.15.132:0/4140377974 learned_addr learned my addr 172.21.15.132:0/4140377974 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d2ca5640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25cc0cd4d0 0x7f25cc0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d1ca3640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25cc0cb770 0x7f25cc137d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 -- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25cc0cb770 msgr2=0x7f25cc137d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25cc0cb770 0x7f25cc137d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 -- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25cc0cd4d0 msgr2=0x7f25cc0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25cc0cd4d0 0x7f25cc0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 -- 172.21.15.132:0/4140377974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25cc1f59b0 con 0x7f25b80039b0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d2ca5640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25cc0cd4d0 0x7f25cc0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d24a4640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25cc1f5470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25c8000f80 tx=0x7f25c80014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8040030 con 0x7f25b80039b0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c802ac40 con 0x7f25b80039b0 2024-04-25T12:50:48.788 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8037040 con 0x7f25b80039b0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25cc13bb20 con 0x7f25b80039b0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.785+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25cc13c0e0 con 0x7f25b80039b0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.786+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25cc0c8920 con 0x7f25b80039b0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.787+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f25c8043070 con 0x7f25b80039b0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.787+0000 7f25c2ffd640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f25b006c920 0x7f25b006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.787+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f25c80abdf0 con 0x7f25b80039b0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.787+0000 7f25d1ca3640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f25b006c920 0x7f25b006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.787+0000 7f25d1ca3640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f25b006c920 0x7f25b006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25cc1ebe40 tx=0x7f25bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:48.789 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.791+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f25cc0c8920 con 0x7f25b80039b0 2024-04-25T12:50:48.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.964+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f25cc0741e0 con 0x7f25b80039b0 2024-04-25T12:50:48.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.964+0000 7f25c2ffd640 1 -- 172.21.15.132:0/4140377974 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7f25c8079f70 con 0x7f25b80039b0 2024-04-25T12:50:48.963 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f25b006c920 msgr2=0x7f25b006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f25b006c920 0x7f25b006ede0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f25cc1ebe40 tx=0x7f25bc008040 comp rx=0 tx=0).stop 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 msgr2=0x7f25cc1f5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25cc1f5470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f25c8000f80 tx=0x7f25c80014a0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 shutdown_connections 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f25b006c920 0x7f25b006ede0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f25cc0cd4d0 0x7f25cc0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f25cc0cb770 0x7f25cc137d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 --2- 172.21.15.132:0/4140377974 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25b80039b0 0x7f25cc1f5470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:48.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 >> 172.21.15.132:0/4140377974 conn(0x7f25cc067a50 msgr2=0x7f25cc06f1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:48.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 shutdown_connections 2024-04-25T12:50:48.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:48.966+0000 7f25d4708640 1 -- 172.21.15.132:0/4140377974 wait complete. 2024-04-25T12:50:48.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.074+0000 7f37c7cb9640 1 Processor -- start 2024-04-25T12:50:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.074+0000 7f37c7cb9640 1 -- start start 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c7cb9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c01443e0 0x7f37c015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c7cb9640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f37c0067d10 0x7f37c0068110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c7cb9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37c00cd660 0x7f37c00cdaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c7cb9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f37c0072cb0 con 0x7f37c00cd660 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c7cb9640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f37c0071de0 con 0x7f37c0067d10 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c7cb9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f37c00720a0 con 0x7f37c01443e0 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37c00cd660 0x7f37c00cdaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.075 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37c00cd660 0x7f37c00cdaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51784/0 (socket says 172.21.15.132:51784) 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 -- 172.21.15.132:0/1191538455 learned_addr learned my addr 172.21.15.132:0/1191538455 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c5254640 1 --2- 172.21.15.132:0/1191538455 >> v2:172.21.15.157:3300/0 conn(0x7f37c0067d10 0x7f37c0068110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c5a55640 1 --2- 172.21.15.132:0/1191538455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c01443e0 0x7f37c015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 -- 172.21.15.132:0/1191538455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c01443e0 msgr2=0x7f37c015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 --2- 172.21.15.132:0/1191538455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c01443e0 0x7f37c015f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 -- 172.21.15.132:0/1191538455 >> v2:172.21.15.157:3300/0 conn(0x7f37c0067d10 msgr2=0x7f37c0068110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 --2- 172.21.15.132:0/1191538455 >> v2:172.21.15.157:3300/0 conn(0x7f37c0067d10 0x7f37c0068110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.075+0000 7f37c6256640 1 -- 172.21.15.132:0/1191538455 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c0072380 con 0x7f37c00cd660 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c6256640 1 --2- 172.21.15.132:0/1191538455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c00cd660 0x7f37c00cdaf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37c0070580 tx=0x7f37b802a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24fb5559cd54219a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c4a53640 1 -- 172.21.15.132:0/1191538455 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8036070 con 0x7f37c00cd660 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c4a53640 1 -- 172.21.15.132:0/1191538455 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8031600 con 0x7f37c00cd660 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c4a53640 1 -- 172.21.15.132:0/1191538455 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b80319d0 con 0x7f37c00cd660 2024-04-25T12:50:49.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1191538455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c00cd660 msgr2=0x7f37c00cdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1191538455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c00cd660 0x7f37c00cdaf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f37c0070580 tx=0x7f37b802a6a0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1191538455 shutdown_connections 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1191538455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c00cd660 0x7f37c00cdaf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1191538455 >> v2:172.21.15.157:3300/0 conn(0x7f37c0067d10 0x7f37c0068110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1191538455 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c01443e0 0x7f37c015f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1191538455 >> 172.21.15.132:0/1191538455 conn(0x7f37c0075d50 msgr2=0x7f37c006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.076+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1191538455 shutdown_connections 2024-04-25T12:50:49.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.077+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1191538455 wait complete. 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 Processor -- start 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 -- start start 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c0067d10 0x7f37c0158630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c00cd660 0x7f37c015b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 0x7f37c00cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f37c01447c0 con 0x7f37c01443e0 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f37c0072940 con 0x7f37c00cd660 2024-04-25T12:50:49.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c7cb9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f37c015c980 con 0x7f37c0067d10 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c6256640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 0x7f37c00cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c6256640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 0x7f37c00cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51796/0 (socket says 172.21.15.132:51796) 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.078+0000 7f37c6256640 1 -- 172.21.15.132:0/1035029116 learned_addr learned my addr 172.21.15.132:0/1035029116 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c6256640 1 -- 172.21.15.132:0/1035029116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c0067d10 msgr2=0x7f37c0158630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c6256640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c0067d10 0x7f37c0158630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c6256640 1 -- 172.21.15.132:0/1035029116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c00cd660 msgr2=0x7f37c015b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c6256640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c00cd660 0x7f37c015b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c6256640 1 -- 172.21.15.132:0/1035029116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37c015b750 con 0x7f37c01443e0 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c6256640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 0x7f37c00cc910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f37b802ac90 tx=0x7f37b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b803f020 con 0x7f37c01443e0 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37b8037040 con 0x7f37c01443e0 2024-04-25T12:50:49.081 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37b8036070 con 0x7f37c01443e0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37c015ba30 con 0x7f37c01443e0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.079+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37c0159520 con 0x7f37c01443e0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.080+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c00cb560 con 0x7f37c01443e0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.080+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37b8042020 con 0x7f37c01443e0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.081+0000 7f37b67fc640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f37a406c8f0 0x7f37a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.081+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f37b80ac5e0 con 0x7f37c01443e0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.081+0000 7f37c5a55640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f37a406c8f0 0x7f37a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.082 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.081+0000 7f37c5a55640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f37a406c8f0 0x7f37a406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f37bc006a90 tx=0x7f37bc006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.083 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.085+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f37c00cb560 con 0x7f37c01443e0 2024-04-25T12:50:49.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.295+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f37c0068c20 con 0x7f37c01443e0 2024-04-25T12:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.296+0000 7f37b67fc640 1 -- 172.21.15.132:0/1035029116 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6841 (secure 0 0 0) 0x7f37b8049020 con 0x7f37c01443e0 2024-04-25T12:50:49.294 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:49.294 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:40.764315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:50:49.294 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2024-04-25T12:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f37a406c8f0 msgr2=0x7f37a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.296 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f37a406c8f0 0x7f37a406edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f37bc006a90 tx=0x7f37bc006a20 comp rx=0 tx=0).stop 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 msgr2=0x7f37c00cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 0x7f37c00cc910 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f37b802ac90 tx=0x7f37b8004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 shutdown_connections 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f37a406c8f0 0x7f37a406edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37c01443e0 0x7f37c00cc910 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f37c00cd660 0x7f37c015b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 --2- 172.21.15.132:0/1035029116 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f37c0067d10 0x7f37c0158630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 >> 172.21.15.132:0/1035029116 conn(0x7f37c0075d50 msgr2=0x7f37c01434b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 shutdown_connections 2024-04-25T12:50:49.297 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.298+0000 7f37c7cb9640 1 -- 172.21.15.132:0/1035029116 wait complete. 2024-04-25T12:50:49.307 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.408+0000 7fb3127ad640 1 Processor -- start 2024-04-25T12:50:49.407 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.408+0000 7fb3127ad640 1 -- start start 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb3127ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 0x7fb30c0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb3127ad640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c0c80e0 con 0x7fb30c06eac0 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb3127ad640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c158000 con 0x7fb30c071940 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb3127ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c1582a0 con 0x7fb30c06e6e0 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb30b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb30c06eac0 0x7fb30c073920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37064/0 (socket says 172.21.15.132:37064) 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb30b7fe640 1 -- 172.21.15.132:0/48767247 learned_addr learned my addr 172.21.15.132:0/48767247 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb30bfff640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 0x7fb30c0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 251548289 0 0) 0x7fb30c0c80e0 con 0x7fb30c06eac0 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.409+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f4003520 con 0x7fb30c06eac0 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165249544 0 0) 0x7fb30c158000 con 0x7fb30c071940 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30c0c80e0 con 0x7fb30c071940 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2267928549 0 0) 0x7fb2f4003520 con 0x7fb30c06eac0 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 msgr2=0x7fb30c0c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 0x7fb30c0c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 >> v1:172.21.15.157:6789/0 conn(0x7fb30c071940 legacy=0x7fb30c157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c158580 con 0x7fb30c06eac0 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7fb300001670 con 0x7fb30c06eac0 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 >> v1:172.21.15.132:6789/0 conn(0x7fb30c06eac0 legacy=0x7fb30c073920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f4003b70 0x7fb2f4003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 0x7fb2f4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f4004d40 0x7fb2f40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c1582a0 con 0x7fb2f4004d40 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f400ba70 con 0x7fb2f4003b70 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb2f400bc20 con 0x7fb30c06e6e0 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb310d4a640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f4004d40 0x7fb2f40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30bfff640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f4003b70 0x7fb2f4003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30b7fe640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 0x7fb2f4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb310d4a640 1 -- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 msgr2=0x7fb2f4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb310d4a640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c06e6e0 0x7fb2f4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb310d4a640 1 -- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f4003b70 msgr2=0x7fb2f4003f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb310d4a640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f4003b70 0x7fb2f4003f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb310d4a640 1 -- 172.21.15.132:0/48767247 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f4003520 con 0x7fb2f4004d40 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.410+0000 7fb30bfff640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2f4003b70 0x7fb2f4003f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.411+0000 7fb310d4a640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f4004d40 0x7fb2f40051c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb304001fd0 tx=0x7fb2f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e27c4c4f1320d4e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.411+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb304001bf0 con 0x7fb2f4004d40 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.411+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb304003b70 con 0x7fb2f4004d40 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.411+0000 7fb30affd640 1 -- 172.21.15.132:0/48767247 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3040050d0 con 0x7fb2f4004d40 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.411+0000 7fb3127ad640 1 -- 172.21.15.132:0/48767247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f4004d40 msgr2=0x7fb2f40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.411+0000 7fb3127ad640 1 --2- 172.21.15.132:0/48767247 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f4004d40 0x7fb2f40051c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb304001fd0 tx=0x7fb2f4005830 comp rx=0 tx=0).stop 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.412+0000 7fb310d4a640 1 -- 172.21.15.132:0/48767247 reap_dead start 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.412+0000 7fb3127ad640 1 -- 172.21.15.132:0/48767247 shutdown_connections 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.412+0000 7fb3127ad640 1 -- 172.21.15.132:0/48767247 >> 172.21.15.132:0/48767247 conn(0x7fb30c067630 msgr2=0x7fb30c067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.412+0000 7fb3127ad640 1 -- 172.21.15.132:0/48767247 shutdown_connections 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.412+0000 7fb3127ad640 1 -- 172.21.15.132:0/48767247 wait complete. 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.413+0000 7fb3127ad640 1 Processor -- start 2024-04-25T12:50:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.413+0000 7fb3127ad640 1 -- start start 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 0x7fb30c1eed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30c15b8f0 0x7fb30c1ef2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c15b2d0 0x7fb30c148030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c0c7680 con 0x7fb30c15aef0 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c0c73a0 con 0x7fb30c15b8f0 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c0c7ba0 con 0x7fb30c15b2d0 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 0x7fb30c1eed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 0x7fb30c1eed80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51804/0 (socket says 172.21.15.132:51804) 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 -- 172.21.15.132:0/1870005416 learned_addr learned my addr 172.21.15.132:0/1870005416 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30b7fe640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30c15b8f0 0x7fb30c1ef2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb310d4a640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c15b2d0 0x7fb30c148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 -- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c15b2d0 msgr2=0x7fb30c148030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c15b2d0 0x7fb30c148030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 -- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30c15b8f0 msgr2=0x7fb30c1ef2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30c15b8f0 0x7fb30c1ef2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 -- 172.21.15.132:0/1870005416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c14c3e0 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb30bfff640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 0x7fb30c1eed80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc011a00 tx=0x7fb2fc011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc00fd30 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc01c480 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc01c870 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c1f2520 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.414+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1f2ae0 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.415+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c068c20 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.416+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb2fc01ca10 con 0x7fb30c15aef0 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.416+0000 7fb308ff9640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2f806c920 0x7fb2f806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.416+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2fc08cd50 con 0x7fb30c15aef0 2024-04-25T12:50:49.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.416+0000 7fb30b7fe640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2f806c920 0x7fb2f806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.417+0000 7fb30b7fe640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2f806c920 0x7fb2f806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb300004840 tx=0x7fb300009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.420+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb2fc090030 con 0x7fb30c15aef0 2024-04-25T12:50:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.595+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb30c067d90 con 0x7fb30c15aef0 2024-04-25T12:50:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.596+0000 7fb308ff9640 1 -- 172.21.15.132:0/1870005416 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7fb2fc05aed0 con 0x7fb30c15aef0 2024-04-25T12:50:49.595 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:49.595 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2f806c920 msgr2=0x7fb2f806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2f806c920 0x7fb2f806ede0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fb300004840 tx=0x7fb300009040 comp rx=0 tx=0).stop 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 msgr2=0x7fb30c1eed80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 0x7fb30c1eed80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc011a00 tx=0x7fb2fc011ec0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 shutdown_connections 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb2f806c920 0x7fb2f806ede0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb30c15b2d0 0x7fb30c148030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb30c15b8f0 0x7fb30c1ef2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 --2- 172.21.15.132:0/1870005416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb30c15aef0 0x7fb30c1eed80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.598+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 >> 172.21.15.132:0/1870005416 conn(0x7fb30c067630 msgr2=0x7fb30c072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.599+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 shutdown_connections 2024-04-25T12:50:49.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.599+0000 7fb3127ad640 1 -- 172.21.15.132:0/1870005416 wait complete. 2024-04-25T12:50:49.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:50:11.154024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:50:11.639000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:50:15.365379+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:50:49.608 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.710+0000 7f1998435640 1 Processor -- start 2024-04-25T12:50:49.708 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.710+0000 7f1998435640 1 -- start start 2024-04-25T12:50:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f1998435640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1990144550 0x7f19900cba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f1998435640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f199015bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f1998435640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19900c9cd0 con 0x7f199015c050 2024-04-25T12:50:49.710 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f1998435640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f199015b330 con 0x7f1990144550 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f1998435640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f199015ee10 con 0x7f199015e920 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1990144550 0x7f19900cba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1990144550 0x7f19900cba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51808/0 (socket says 172.21.15.132:51808) 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 -- 172.21.15.132:0/4235390255 learned_addr learned my addr 172.21.15.132:0/4235390255 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19959d0640 1 --2- 172.21.15.132:0/4235390255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f199015bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 -- 172.21.15.132:0/4235390255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 msgr2=0x7f199015bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 --2- 172.21.15.132:0/4235390255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f199015bb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 -- 172.21.15.132:0/4235390255 >> v1:172.21.15.157:6789/0 conn(0x7f199015c050 legacy=0x7f1990072ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.711+0000 7f19961d1640 1 -- 172.21.15.132:0/4235390255 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199015f0f0 con 0x7f1990144550 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.712+0000 7f19961d1640 1 --2- 172.21.15.132:0/4235390255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900cba40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f198c009e50 tx=0x7f198c02a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed8a3d666764f8ec server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.712+0000 7f19951cf640 1 -- 172.21.15.132:0/4235390255 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c036070 con 0x7f1990144550 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.712+0000 7f19951cf640 1 -- 172.21.15.132:0/4235390255 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c031600 con 0x7f1990144550 2024-04-25T12:50:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.712+0000 7f19951cf640 1 -- 172.21.15.132:0/4235390255 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c0319d0 con 0x7f1990144550 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 -- 172.21.15.132:0/4235390255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 msgr2=0x7f19900cba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 --2- 172.21.15.132:0/4235390255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900cba40 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f198c009e50 tx=0x7f198c02a710 comp rx=0 tx=0).stop 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 -- 172.21.15.132:0/4235390255 shutdown_connections 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 --2- 172.21.15.132:0/4235390255 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f199015bb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 --2- 172.21.15.132:0/4235390255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900cba40 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 -- 172.21.15.132:0/4235390255 >> 172.21.15.132:0/4235390255 conn(0x7f1990070a90 msgr2=0x7f1990070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 -- 172.21.15.132:0/4235390255 shutdown_connections 2024-04-25T12:50:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.713+0000 7f1998435640 1 -- 172.21.15.132:0/4235390255 wait complete. 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.714+0000 7f1998435640 1 Processor -- start 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.714+0000 7f1998435640 1 -- start start 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f199015c050 0x7f19901f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f1990142ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f199015b5f0 con 0x7f1990144550 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f199015f6b0 con 0x7f199015c050 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f199006c5f0 con 0x7f199015e920 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900ca160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51816/0 (socket says 172.21.15.132:51816) 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 -- 172.21.15.132:0/2493859426 learned_addr learned my addr 172.21.15.132:0/2493859426 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19959d0640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f199015c050 0x7f19901f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19969d2640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f1990142ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 -- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 msgr2=0x7f1990142ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f1990142ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 -- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f199015c050 msgr2=0x7f19901f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f199015c050 0x7f19901f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 -- 172.21.15.132:0/2493859426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19901f55d0 con 0x7f1990144550 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19959d0640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f199015c050 0x7f19901f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f19961d1640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900ca160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f198c034040 tx=0x7f198c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c036050 con 0x7f1990144550 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f198c042070 con 0x7f1990144550 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19900cf290 con 0x7f1990144550 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c009510 con 0x7f1990144550 2024-04-25T12:50:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.715+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19901f4af0 con 0x7f1990144550 2024-04-25T12:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.716+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1990068d00 con 0x7f1990144550 2024-04-25T12:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.717+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f198c007c50 con 0x7f1990144550 2024-04-25T12:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.717+0000 7f1986ffd640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f197406c920 0x7f197406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.717+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f198c0acd10 con 0x7f1990144550 2024-04-25T12:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.717+0000 7f19959d0640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f197406c920 0x7f197406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.718+0000 7f19959d0640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f197406c920 0x7f197406ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19901f22a0 tx=0x7f1980008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.722+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f198c07ae00 con 0x7f1990144550 2024-04-25T12:50:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.897+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19900c9330 con 0x7f1990144550 2024-04-25T12:50:49.895 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.897+0000 7f1986ffd640 1 -- 172.21.15.132:0/2493859426 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f198c07a700 con 0x7f1990144550 2024-04-25T12:50:49.895 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f197406c920 msgr2=0x7f197406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f197406c920 0x7f197406ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f19901f22a0 tx=0x7f1980008040 comp rx=0 tx=0).stop 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 msgr2=0x7f19900ca160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900ca160 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f198c034040 tx=0x7f198c004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 shutdown_connections 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f197406c920 0x7f197406ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f199015e920 0x7f1990142ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f199015c050 0x7f19901f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 --2- 172.21.15.132:0/2493859426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1990144550 0x7f19900ca160 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 >> 172.21.15.132:0/2493859426 conn(0x7f1990070a90 msgr2=0x7f1990072ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 shutdown_connections 2024-04-25T12:50:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:49.899+0000 7f1998435640 1 -- 172.21.15.132:0/2493859426 wait complete. 2024-04-25T12:50:49.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 Processor -- start 2024-04-25T12:50:50.008 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 -- start start 2024-04-25T12:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 0x7f74b40cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 0x7f74b415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b415f430 con 0x7f74b40cc230 2024-04-25T12:50:50.009 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f74b415b2e0 con 0x7f74b415ea60 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.010+0000 7f74b93e5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f74b415b580 con 0x7f74b4155530 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 0x7f74b40cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b37fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 0x7f74b415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 0x7f74b40cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:55522/0 (socket says 172.21.15.132:55522) 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b27fc640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f74b40cc230 0x7f74b4072b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60910/0 (socket says 172.21.15.132:60910) 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b37fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 0x7f74b415eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:40144/0 (socket says 172.21.15.132:40144) 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 -- 172.21.15.132:0/355568062 learned_addr learned my addr 172.21.15.132:0/355568062 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 -- 172.21.15.132:0/355568062 >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 msgr2=0x7f74b415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 --2- 172.21.15.132:0/355568062 >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 0x7f74b415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 -- 172.21.15.132:0/355568062 >> v1:172.21.15.157:6789/0 conn(0x7f74b40cc230 legacy=0x7f74b4072b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b2ffd640 1 -- 172.21.15.132:0/355568062 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b415b860 con 0x7f74b4155530 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b1ffb640 1 -- 172.21.15.132:0/355568062 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 432408391 0 0) 0x7f74b415f430 con 0x7f74b40cc230 2024-04-25T12:50:50.010 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.011+0000 7f74b37fe640 1 --2- 172.21.15.132:0/355568062 >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 0x7f74b415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.012+0000 7f74b2ffd640 1 --2- 172.21.15.132:0/355568062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 0x7f74b40cb310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009870 tx=0x7f74a402a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52795566edc7bff8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.012+0000 7f74b1ffb640 1 -- 172.21.15.132:0/355568062 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4037070 con 0x7f74b4155530 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.012+0000 7f74b1ffb640 1 -- 172.21.15.132:0/355568062 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a402ae50 con 0x7f74b4155530 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.012+0000 7f74b1ffb640 1 -- 172.21.15.132:0/355568062 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4032860 con 0x7f74b4155530 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 -- 172.21.15.132:0/355568062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 msgr2=0x7f74b40cb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 --2- 172.21.15.132:0/355568062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 0x7f74b40cb310 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009870 tx=0x7f74a402a300 comp rx=0 tx=0).stop 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 -- 172.21.15.132:0/355568062 shutdown_connections 2024-04-25T12:50:50.012 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 --2- 172.21.15.132:0/355568062 >> v2:172.21.15.157:3300/0 conn(0x7f74b415ea60 0x7f74b415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 --2- 172.21.15.132:0/355568062 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b4155530 0x7f74b40cb310 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 -- 172.21.15.132:0/355568062 >> 172.21.15.132:0/355568062 conn(0x7f74b4075d50 msgr2=0x7f74b406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 -- 172.21.15.132:0/355568062 shutdown_connections 2024-04-25T12:50:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.013+0000 7f74b93e5640 1 -- 172.21.15.132:0/355568062 wait complete. 2024-04-25T12:50:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.014+0000 7f74b93e5640 1 Processor -- start 2024-04-25T12:50:50.013 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.014+0000 7f74b93e5640 1 -- start start 2024-04-25T12:50:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 0x7f74b41591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74b4155530 0x7f74b415c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b415ea60 0x7f74b415ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f74b40cb850 con 0x7f74b40cc230 2024-04-25T12:50:50.015 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f74b415be20 con 0x7f74b4155530 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f74b40ce2b0 con 0x7f74b415ea60 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 0x7f74b41591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 0x7f74b41591b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51830/0 (socket says 172.21.15.132:51830) 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 -- 172.21.15.132:0/2779205117 learned_addr learned my addr 172.21.15.132:0/2779205117 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b37fe640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b415ea60 0x7f74b415ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b27fc640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74b4155530 0x7f74b415c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 -- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b415ea60 msgr2=0x7f74b415ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b415ea60 0x7f74b415ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 -- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74b4155530 msgr2=0x7f74b415c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74b4155530 0x7f74b415c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 -- 172.21.15.132:0/2779205117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b41f13f0 con 0x7f74b40cc230 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b2ffd640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 0x7f74b41591b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009870 tx=0x7f74a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4037040 con 0x7f74b40cc230 2024-04-25T12:50:50.016 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74a4004230 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b41f16d0 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a4003610 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.015+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b41f1c90 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.016+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74b41f1ed0 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.017+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f74a403a040 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.017+0000 7f749b7fe640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f74a006c920 0x7f74a006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.017+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f74a40ac330 con 0x7f74b40cc230 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.017+0000 7f74b27fc640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f74a006c920 0x7f74a006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.017 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.018+0000 7f74b27fc640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f74a006c920 0x7f74a006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74b415a630 tx=0x7f74a8007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.019 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.021+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f74b41f1ed0 con 0x7f74b40cc230 2024-04-25T12:50:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.197+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74b406a5a0 con 0x7f74b40cc230 2024-04-25T12:50:50.196 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.198+0000 7f749b7fe640 1 -- 172.21.15.132:0/2779205117 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) ==== 104+0+11 (secure 0 0 0) 0x7f74b406a5a0 con 0x7f74b40cc230 2024-04-25T12:50:50.196 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f74a006c920 msgr2=0x7f74a006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f74a006c920 0x7f74a006ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f74b415a630 tx=0x7f74a8007d50 comp rx=0 tx=0).stop 2024-04-25T12:50:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 msgr2=0x7f74b41591b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.198 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 0x7f74b41591b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f74a4009870 tx=0x7f74a40046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 shutdown_connections 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f74a006c920 0x7f74a006ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f74b415ea60 0x7f74b415ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f74b4155530 0x7f74b415c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 --2- 172.21.15.132:0/2779205117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f74b40cc230 0x7f74b41591b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 >> 172.21.15.132:0/2779205117 conn(0x7f74b4075d50 msgr2=0x7f74b4154790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 shutdown_connections 2024-04-25T12:50:50.199 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.200+0000 7f74b93e5640 1 -- 172.21.15.132:0/2779205117 wait complete. 2024-04-25T12:50:50.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:50:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.311+0000 7f7921de1640 1 Processor -- start 2024-04-25T12:50:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.311+0000 7f7921de1640 1 -- start start 2024-04-25T12:50:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f7921de1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c1534f0 0x7f791c15c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.319 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f7921de1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791c1538d0 con 0x7f791c0cbcb0 2024-04-25T12:50:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f7921de1640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f791c159130 con 0x7f791c072ea0 2024-04-25T12:50:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f7921de1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f791c0c6670 con 0x7f791c1534f0 2024-04-25T12:50:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f791c0cbcb0 0x7f791c0c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37080/0 (socket says 172.21.15.132:37080) 2024-04-25T12:50:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791affd640 1 -- 172.21.15.132:0/1768209592 learned_addr learned my addr 172.21.15.132:0/1768209592 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791b7fe640 1 --2- 172.21.15.132:0/1768209592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c1534f0 0x7f791c15c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435445524 0 0) 0x7f791c1538d0 con 0x7f791c0cbcb0 2024-04-25T12:50:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7904003520 con 0x7f791c0cbcb0 2024-04-25T12:50:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036848048 0 0) 0x7f791c159130 con 0x7f791c072ea0 2024-04-25T12:50:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f791c1538d0 con 0x7f791c072ea0 2024-04-25T12:50:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791b7fe640 1 -- 172.21.15.132:0/1768209592 >> v1:172.21.15.157:6789/0 conn(0x7f791c072ea0 legacy=0x7f791c163a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791b7fe640 1 -- 172.21.15.132:0/1768209592 >> v1:172.21.15.132:6789/0 conn(0x7f791c0cbcb0 legacy=0x7f791c0c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.321 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.312+0000 7f791b7fe640 1 -- 172.21.15.132:0/1768209592 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c0c6950 con 0x7f791c1534f0 2024-04-25T12:50:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.313+0000 7f791b7fe640 1 --2- 172.21.15.132:0/1768209592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c1534f0 0x7f791c15c6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f790c0097d0 tx=0x7f790c02a210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e2109719d63781b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.313+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c037070 con 0x7f791c1534f0 2024-04-25T12:50:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.313+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f790c032440 con 0x7f791c1534f0 2024-04-25T12:50:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.313+0000 7f791a7fc640 1 -- 172.21.15.132:0/1768209592 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790c0327f0 con 0x7f791c1534f0 2024-04-25T12:50:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 -- 172.21.15.132:0/1768209592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c1534f0 msgr2=0x7f791c15c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.322 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 --2- 172.21.15.132:0/1768209592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c1534f0 0x7f791c15c6a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f790c0097d0 tx=0x7f790c02a210 comp rx=0 tx=0).stop 2024-04-25T12:50:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 -- 172.21.15.132:0/1768209592 shutdown_connections 2024-04-25T12:50:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 --2- 172.21.15.132:0/1768209592 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c1534f0 0x7f791c15c6a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 -- 172.21.15.132:0/1768209592 >> 172.21.15.132:0/1768209592 conn(0x7f791c070a90 msgr2=0x7f791c070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 -- 172.21.15.132:0/1768209592 shutdown_connections 2024-04-25T12:50:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.314+0000 7f7921de1640 1 -- 172.21.15.132:0/1768209592 wait complete. 2024-04-25T12:50:50.323 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.315+0000 7f7921de1640 1 Processor -- start 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.315+0000 7f7921de1640 1 -- start start 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7921de1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c072ea0 0x7f791c146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7921de1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f791c0cbcb0 0x7f791c15c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7921de1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 0x7f791c0cdab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7921de1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f791c15cbe0 con 0x7f791c1534f0 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7921de1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f791c1596d0 con 0x7f791c0cbcb0 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7921de1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f791c0c8cb0 con 0x7f791c072ea0 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 0x7f791c0cdab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.324 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 0x7f791c0cdab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51838/0 (socket says 172.21.15.132:51838) 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 -- 172.21.15.132:0/2062223413 learned_addr learned my addr 172.21.15.132:0/2062223413 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791affd640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f791c0cbcb0 0x7f791c15c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791b7fe640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c072ea0 0x7f791c146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 -- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c072ea0 msgr2=0x7f791c146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c072ea0 0x7f791c146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 -- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f791c0cbcb0 msgr2=0x7f791c15c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f791c0cbcb0 0x7f791c15c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.325 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 -- 172.21.15.132:0/2062223413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f791c0cc730 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f791bfff640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 0x7f791c0cdab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f791400c6e0 tx=0x7f791400cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.316+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7914003b70 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.317+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7914003d10 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.317+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f791c0cc9d0 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.317+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79140052d0 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.317+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f791c0ccf90 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.317+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f791c068d00 con 0x7f791c1534f0 2024-04-25T12:50:50.326 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.318+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7914005470 con 0x7f791c1534f0 2024-04-25T12:50:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.318+0000 7f7903fff640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f790806c8f0 0x7f790806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.318+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f791408bc20 con 0x7f791c1534f0 2024-04-25T12:50:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.318+0000 7f791b7fe640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f790806c8f0 0x7f790806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.319+0000 7f791b7fe640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f790806c8f0 0x7f790806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f790c034000 tx=0x7f790c02e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.327 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.323+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79140596c0 con 0x7f791c1534f0 2024-04-25T12:50:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.503+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f791c0cd700 con 0x7f791c1534f0 2024-04-25T12:50:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.503+0000 7f7903fff640 1 -- 172.21.15.132:0/2062223413 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) ==== 100+0+11 (secure 0 0 0) 0x7f791405d9c0 con 0x7f791c1534f0 2024-04-25T12:50:50.501 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f790806c8f0 msgr2=0x7f790806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f790806c8f0 0x7f790806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f790c034000 tx=0x7f790c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 msgr2=0x7f791c0cdab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 0x7f791c0cdab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f791400c6e0 tx=0x7f791400cba0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 shutdown_connections 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f790806c8f0 0x7f790806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f791c1534f0 0x7f791c0cdab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f791c0cbcb0 0x7f791c15c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 --2- 172.21.15.132:0/2062223413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f791c072ea0 0x7f791c146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 >> 172.21.15.132:0/2062223413 conn(0x7f791c070a90 msgr2=0x7f791c0c9550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 shutdown_connections 2024-04-25T12:50:50.504 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.505+0000 7f7921de1640 1 -- 172.21.15.132:0/2062223413 wait complete. 2024-04-25T12:50:50.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:50:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.616+0000 7fcdc65f7640 1 Processor -- start 2024-04-25T12:50:50.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.616+0000 7fcdc65f7640 1 -- start start 2024-04-25T12:50:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc65f7640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcdc0072010 0x7fcdc015f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc65f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00723f0 0x7fcdc006fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc65f7640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc015f660 con 0x7fcdc00ce410 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc65f7640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcdc015b310 con 0x7fcdc0072010 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc65f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc015b5d0 con 0x7fcdc00723f0 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcdc0072010 0x7fcdc015f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbf7fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00723f0 0x7fcdc006fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc4b94640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fcdc00ce410 0x7fcdc0143ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:60930/0 (socket says 172.21.15.132:60930) 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdc4b94640 1 -- 172.21.15.132:0/3576601026 learned_addr learned my addr 172.21.15.132:0/3576601026 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbffff640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcdc0072010 0x7fcdc015f120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:40164/0 (socket says 172.21.15.132:40164) 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbffff640 1 -- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00723f0 msgr2=0x7fcdc006fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbffff640 1 --2- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00723f0 0x7fcdc006fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbffff640 1 -- 172.21.15.132:0/3576601026 >> v1:172.21.15.157:6789/0 conn(0x7fcdc00ce410 legacy=0x7fcdc0143ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbffff640 1 -- 172.21.15.132:0/3576601026 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc015b8b0 con 0x7fcdc0072010 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.617+0000 7fcdbf7fe640 1 --2- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00723f0 0x7fcdc006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.618+0000 7fcdbffff640 1 --2- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc0072010 0x7fcdc015f120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00097a0 tx=0x7fcdb002a210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d2becc408dc74e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.617 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.618+0000 7fcdbeffd640 1 -- 172.21.15.132:0/3576601026 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0037070 con 0x7fcdc0072010 2024-04-25T12:50:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.618+0000 7fcdbeffd640 1 -- 172.21.15.132:0/3576601026 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb0032440 con 0x7fcdc0072010 2024-04-25T12:50:50.618 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.618+0000 7fcdbeffd640 1 -- 172.21.15.132:0/3576601026 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0032810 con 0x7fcdc0072010 2024-04-25T12:50:50.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc0072010 msgr2=0x7fcdc015f120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc0072010 0x7fcdc015f120 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcdb00097a0 tx=0x7fcdb002a210 comp rx=0 tx=0).stop 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3576601026 shutdown_connections 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00723f0 0x7fcdc006fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3576601026 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc0072010 0x7fcdc015f120 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3576601026 >> 172.21.15.132:0/3576601026 conn(0x7fcdc00cd840 msgr2=0x7fcdc00cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3576601026 shutdown_connections 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.619+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3576601026 wait complete. 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.620+0000 7fcdc65f7640 1 Processor -- start 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.620+0000 7fcdc65f7640 1 -- start start 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc65f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 0x7fcdc01f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc65f7640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc00723f0 0x7fcdc01f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.621 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc65f7640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00ce410 0x7fcdc01f4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc65f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc0072a30 con 0x7fcdc0072010 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc65f7640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc015be70 con 0x7fcdc00723f0 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc65f7640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcdc01445f0 con 0x7fcdc00ce410 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 0x7fcdc01f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 0x7fcdc01f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51842/0 (socket says 172.21.15.132:51842) 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 -- 172.21.15.132:0/3337926547 learned_addr learned my addr 172.21.15.132:0/3337926547 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbf7fe640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc00723f0 0x7fcdc01f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdc4b94640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00ce410 0x7fcdc01f4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 -- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00ce410 msgr2=0x7fcdc01f4250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00ce410 0x7fcdc01f4250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 -- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc00723f0 msgr2=0x7fcdc01f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc00723f0 0x7fcdc01f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.622 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 -- 172.21.15.132:0/3337926547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc01e6260 con 0x7fcdc0072010 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.621+0000 7fcdbffff640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 0x7fcdc01f1ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0035040 tx=0x7fcdb00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.622+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0037040 con 0x7fcdc0072010 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.622+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdb0030500 con 0x7fcdc0072010 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.622+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc01e6540 con 0x7fcdc0072010 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.622+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdb0030910 con 0x7fcdc0072010 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.622+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc01e6b00 con 0x7fcdc0072010 2024-04-25T12:50:50.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.623+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc0069ce0 con 0x7fcdc0072010 2024-04-25T12:50:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.623+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcdb0044020 con 0x7fcdc0072010 2024-04-25T12:50:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.623+0000 7fcdbcff9640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcdac06c920 0x7fcdac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.623+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcdb00ac000 con 0x7fcdc0072010 2024-04-25T12:50:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.624+0000 7fcdbf7fe640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcdac06c920 0x7fcdac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.624 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.624+0000 7fcdbf7fe640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcdac06c920 0x7fcdac06ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00cb2f0 tx=0x7fcdb4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.628+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcdb0079a10 con 0x7fcdc0072010 2024-04-25T12:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.802+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcdc0155a10 con 0x7fcdc0072010 2024-04-25T12:50:50.800 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.802+0000 7fcdbcff9640 1 -- 172.21.15.132:0/3337926547 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) ==== 103+0+11 (secure 0 0 0) 0x7fcdb007dd10 con 0x7fcdc0072010 2024-04-25T12:50:50.800 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcdac06c920 msgr2=0x7fcdac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcdac06c920 0x7fcdac06ede0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcdc00cb2f0 tx=0x7fcdb4009190 comp rx=0 tx=0).stop 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 msgr2=0x7fcdc01f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 0x7fcdc01f1ee0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcdb0035040 tx=0x7fcdb00046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 shutdown_connections 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcdac06c920 0x7fcdac06ede0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcdc00ce410 0x7fcdc01f4250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcdc00723f0 0x7fcdc01f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 --2- 172.21.15.132:0/3337926547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcdc0072010 0x7fcdc01f1ee0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 >> 172.21.15.132:0/3337926547 conn(0x7fcdc00cd840 msgr2=0x7fcdc0143cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 shutdown_connections 2024-04-25T12:50:50.803 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.804+0000 7fcdc65f7640 1 -- 172.21.15.132:0/3337926547 wait complete. 2024-04-25T12:50:50.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.912+0000 7f670e220640 1 Processor -- start 2024-04-25T12:50:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.912+0000 7f670e220640 1 -- start start 2024-04-25T12:50:50.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f670e220640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67080c6040 0x7f67080c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.912 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f670e220640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6708152d40 0x7f67081531b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f670e220640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67080c7160 con 0x7f67080c6420 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f670e220640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f67081536f0 con 0x7f6708152d40 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f670e220640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f67080c7420 con 0x7f67080c6040 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6708152d40 0x7f67081531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6708152d40 0x7f67081531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51850/0 (socket says 172.21.15.132:51850) 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 -- 172.21.15.132:0/3275248953 learned_addr learned my addr 172.21.15.132:0/3275248953 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f67077fe640 1 --2- 172.21.15.132:0/3275248953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67080c6040 0x7f67080c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 -- 172.21.15.132:0/3275248953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67080c6040 msgr2=0x7f67080c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 --2- 172.21.15.132:0/3275248953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67080c6040 0x7f67080c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 -- 172.21.15.132:0/3275248953 >> v1:172.21.15.157:6789/0 conn(0x7f67080c6420 legacy=0x7f670806f030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.913+0000 7f6707fff640 1 -- 172.21.15.132:0/3275248953 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67080c7700 con 0x7f6708152d40 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.914+0000 7f6707fff640 1 --2- 172.21.15.132:0/3275248953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6708152d40 0x7f67081531b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6700009e50 tx=0x7f670002a750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2592cb1ffa60c117 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.913 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.914+0000 7f67067fc640 1 -- 172.21.15.132:0/3275248953 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700036070 con 0x7f6708152d40 2024-04-25T12:50:50.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.914+0000 7f67067fc640 1 -- 172.21.15.132:0/3275248953 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6700031600 con 0x7f6708152d40 2024-04-25T12:50:50.914 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.914+0000 7f67067fc640 1 -- 172.21.15.132:0/3275248953 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67000319d0 con 0x7f6708152d40 2024-04-25T12:50:50.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 -- 172.21.15.132:0/3275248953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6708152d40 msgr2=0x7f67081531b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.916 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 --2- 172.21.15.132:0/3275248953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6708152d40 0x7f67081531b0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f6700009e50 tx=0x7f670002a750 comp rx=0 tx=0).stop 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 -- 172.21.15.132:0/3275248953 shutdown_connections 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 --2- 172.21.15.132:0/3275248953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6708152d40 0x7f67081531b0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 --2- 172.21.15.132:0/3275248953 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f67080c6040 0x7f67080c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 -- 172.21.15.132:0/3275248953 >> 172.21.15.132:0/3275248953 conn(0x7f6708067630 msgr2=0x7f6708067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 -- 172.21.15.132:0/3275248953 shutdown_connections 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.915+0000 7f670e220640 1 -- 172.21.15.132:0/3275248953 wait complete. 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.916+0000 7f670e220640 1 Processor -- start 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.916+0000 7f670e220640 1 -- start start 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f670e220640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 0x7f670814e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f670e220640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67080c6420 0x7f67080c5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f670e220640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6708152d40 0x7f670815bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f670e220640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f67080c8630 con 0x7f67080c6040 2024-04-25T12:50:50.917 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f670e220640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f67080c7cc0 con 0x7f67080c6420 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f670e220640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f67081594e0 con 0x7f6708152d40 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 0x7f670814e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 0x7f670814e8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51858/0 (socket says 172.21.15.132:51858) 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 -- 172.21.15.132:0/2814975444 learned_addr learned my addr 172.21.15.132:0/2814975444 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f6706ffd640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67080c6420 0x7f67080c5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f6707fff640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6708152d40 0x7f670815bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 -- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6708152d40 msgr2=0x7f670815bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6708152d40 0x7f670815bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 -- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67080c6420 msgr2=0x7f67080c5040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67080c6420 0x7f67080c5040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 -- 172.21.15.132:0/2814975444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67080c5680 con 0x7f67080c6040 2024-04-25T12:50:50.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f6706ffd640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67080c6420 0x7f67080c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f67077fe640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 0x7f670814e8e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66f800d830 tx=0x7f66f800dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.917+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f800b660 con 0x7f67080c6040 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.918+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f8019070 con 0x7f67080c6040 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.918+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67080c5960 con 0x7f67080c6040 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.918+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f800ba20 con 0x7f67080c6040 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.918+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670814fe50 con 0x7f67080c6040 2024-04-25T12:50:50.919 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.919+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6708068c20 con 0x7f67080c6040 2024-04-25T12:50:50.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.919+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f66f801e460 con 0x7f67080c6040 2024-04-25T12:50:50.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.919+0000 7f66effff640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f66f406c920 0x7f66f406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:50.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.919+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f66f808c510 con 0x7f67080c6040 2024-04-25T12:50:50.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.919+0000 7f6706ffd640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f66f406c920 0x7f66f406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:50.920 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.920+0000 7f6706ffd640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f66f406c920 0x7f66f406ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f670806f820 tx=0x7f66fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:50.921 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:50.924+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f66f805a570 con 0x7f67080c6040 2024-04-25T12:50:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.134+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f670806f070 con 0x7f67080c6040 2024-04-25T12:50:51.133 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.135+0000 7f66effff640 1 -- 172.21.15.132:0/2814975444 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6841 (secure 0 0 0) 0x7f66f8059e70 con 0x7f67080c6040 2024-04-25T12:50:51.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:51.133 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:40.764315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:50:51.133 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f66f406c920 msgr2=0x7f66f406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f66f406c920 0x7f66f406ede0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f670806f820 tx=0x7f66fc009040 comp rx=0 tx=0).stop 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 msgr2=0x7f670814e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 0x7f670814e8e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f66f800d830 tx=0x7f66f800dcf0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 shutdown_connections 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f66f406c920 0x7f66f406ede0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.135 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6708152d40 0x7f670815bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f67080c6420 0x7f67080c5040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 --2- 172.21.15.132:0/2814975444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080c6040 0x7f670814e8e0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 >> 172.21.15.132:0/2814975444 conn(0x7f6708067630 msgr2=0x7f67081508a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:51.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 shutdown_connections 2024-04-25T12:50:51.136 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.137+0000 7f670e220640 1 -- 172.21.15.132:0/2814975444 wait complete. 2024-04-25T12:50:51.146 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:51.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.244+0000 7f179c7f9640 1 Processor -- start 2024-04-25T12:50:51.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.244+0000 7f179c7f9640 1 -- start start 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179c7f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17941557e0 0x7f17940cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179c7f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17940cc730 0x7f17940cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179c7f9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f179415ed80 con 0x7f179406c9c0 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179c7f9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f17940cb5a0 con 0x7f17940cc730 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179c7f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f179415f060 con 0x7f17941557e0 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f1799d94640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17940cc730 0x7f17940cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179ad96640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f179406c9c0 0x7f179406ce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37096/0 (socket says 172.21.15.132:37096) 2024-04-25T12:50:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.245+0000 7f179ad96640 1 -- 172.21.15.132:0/195209443 learned_addr learned my addr 172.21.15.132:0/195209443 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f179a595640 1 --2- 172.21.15.132:0/195209443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17941557e0 0x7f17940cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f1799d94640 1 -- 172.21.15.132:0/195209443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17941557e0 msgr2=0x7f17940cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f1799d94640 1 --2- 172.21.15.132:0/195209443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17941557e0 0x7f17940cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f1799d94640 1 -- 172.21.15.132:0/195209443 >> v1:172.21.15.132:6789/0 conn(0x7f179406c9c0 legacy=0x7f179406ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f1799d94640 1 -- 172.21.15.132:0/195209443 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179415f340 con 0x7f17940cc730 2024-04-25T12:50:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f1799593640 1 -- 172.21.15.132:0/195209443 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2127813369 0 0) 0x7f179415ed80 con 0x7f179406c9c0 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.246+0000 7f1799d94640 1 --2- 172.21.15.132:0/195209443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940cc730 0x7f17940cbf70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f178402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95a5f19a2c9c4b35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f1799593640 1 -- 172.21.15.132:0/195209443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784037070 con 0x7f17940cc730 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f1799593640 1 -- 172.21.15.132:0/195209443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1784032440 con 0x7f17940cc730 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f1799593640 1 -- 172.21.15.132:0/195209443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1784032810 con 0x7f17940cc730 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 -- 172.21.15.132:0/195209443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940cc730 msgr2=0x7f17940cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 --2- 172.21.15.132:0/195209443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940cc730 0x7f17940cbf70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f17840097a0 tx=0x7f178402a180 comp rx=0 tx=0).stop 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 -- 172.21.15.132:0/195209443 shutdown_connections 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 --2- 172.21.15.132:0/195209443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940cc730 0x7f17940cbf70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 --2- 172.21.15.132:0/195209443 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17941557e0 0x7f17940cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 -- 172.21.15.132:0/195209443 >> 172.21.15.132:0/195209443 conn(0x7f17940d0e10 msgr2=0x7f17940d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 -- 172.21.15.132:0/195209443 shutdown_connections 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.247+0000 7f179c7f9640 1 -- 172.21.15.132:0/195209443 wait complete. 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.248+0000 7f179c7f9640 1 Processor -- start 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.248+0000 7f179c7f9640 1 -- start start 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179c7f9640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179406c9c0 0x7f17941e4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179c7f9640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17940cc730 0x7f179415d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179c7f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 0x7f179415d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179c7f9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f179406d6b0 con 0x7f17941557e0 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179c7f9640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f179406d530 con 0x7f179406c9c0 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179c7f9640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f17940cd0c0 con 0x7f17940cc730 2024-04-25T12:50:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 0x7f179415d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 0x7f179415d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51874/0 (socket says 172.21.15.132:51874) 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 -- 172.21.15.132:0/2830217357 learned_addr learned my addr 172.21.15.132:0/2830217357 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f1799d94640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17940cc730 0x7f179415d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179a595640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179406c9c0 0x7f17941e4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 -- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17940cc730 msgr2=0x7f179415d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17940cc730 0x7f179415d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 -- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179406c9c0 msgr2=0x7f17941e4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179406c9c0 0x7f17941e4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179ad96640 1 -- 172.21.15.132:0/2830217357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17940d0310 con 0x7f17941557e0 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f1799d94640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17940cc730 0x7f179415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.249+0000 7f179a595640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179406c9c0 0x7f17941e4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.250+0000 7f179ad96640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 0x7f179415d6d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c450 tx=0x7f178c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.250+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c018070 con 0x7f17941557e0 2024-04-25T12:50:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.250+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f178c007500 con 0x7f17941557e0 2024-04-25T12:50:51.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.250+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17940d05b0 con 0x7f17941557e0 2024-04-25T12:50:51.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.250+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178c004a20 con 0x7f17941557e0 2024-04-25T12:50:51.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.250+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17941f4340 con 0x7f17941557e0 2024-04-25T12:50:51.252 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.251+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1794069330 con 0x7f17941557e0 2024-04-25T12:50:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.251+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f178c01b070 con 0x7f17941557e0 2024-04-25T12:50:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.252+0000 7f178affd640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f177806c8f0 0x7f177806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.252+0000 7f179a595640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f177806c8f0 0x7f177806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.252+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f178c08b1e0 con 0x7f17941557e0 2024-04-25T12:50:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.252+0000 7f179a595640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f177806c8f0 0x7f177806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1790007440 tx=0x7f179000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.256+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1794069330 con 0x7f17941557e0 2024-04-25T12:50:51.432 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.433+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1794068c20 con 0x7f17941557e0 2024-04-25T12:50:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.435+0000 7f178affd640 1 -- 172.21.15.132:0/2830217357 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18550 (secure 0 0 0) 0x7f178c059240 con 0x7f17941557e0 2024-04-25T12:50:51.433 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:51.433 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":25,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:17.729754+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f177806c8f0 msgr2=0x7f177806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f177806c8f0 0x7f177806edb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f1790007440 tx=0x7f179000b040 comp rx=0 tx=0).stop 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 msgr2=0x7f179415d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 0x7f179415d6d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f178c00c450 tx=0x7f178c00c910 comp rx=0 tx=0).stop 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 shutdown_connections 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f177806c8f0 0x7f177806edb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17941557e0 0x7f179415d6d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17940cc730 0x7f179415d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 --2- 172.21.15.132:0/2830217357 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f179406c9c0 0x7f17941e4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 >> 172.21.15.132:0/2830217357 conn(0x7f17940d0e10 msgr2=0x7f1794154160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 shutdown_connections 2024-04-25T12:50:51.436 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.437+0000 7f179c7f9640 1 -- 172.21.15.132:0/2830217357 wait complete. 2024-04-25T12:50:51.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:50:51.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.545+0000 7f669e885640 1 Processor -- start 2024-04-25T12:50:51.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.545+0000 7f669e885640 1 -- start start 2024-04-25T12:50:51.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f669e885640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f669815f2b0 0x7f66980cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f669e885640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f669e885640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6698071de0 con 0x7f66981443e0 2024-04-25T12:50:51.547 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f669e885640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f669815f6b0 con 0x7f669815f2b0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f669e885640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6698072cb0 con 0x7f66980cdba0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f66977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f669815f2b0 0x7f66980cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f6697fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f66981443e0 0x7f6698067d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:37108/0 (socket says 172.21.15.132:37108) 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f6697fff640 1 -- 172.21.15.132:0/1095250499 learned_addr learned my addr 172.21.15.132:0/1095250499 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f669ce22640 1 --2- 172.21.15.132:0/1095250499 >> v2:172.21.15.157:3300/0 conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f66977fe640 1 -- 172.21.15.132:0/1095250499 >> v2:172.21.15.157:3300/0 conn(0x7f66980cdba0 msgr2=0x7f669815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f66977fe640 1 --2- 172.21.15.132:0/1095250499 >> v2:172.21.15.157:3300/0 conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f66977fe640 1 -- 172.21.15.132:0/1095250499 >> v1:172.21.15.132:6789/0 conn(0x7f66981443e0 legacy=0x7f6698067d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f66977fe640 1 -- 172.21.15.132:0/1095250499 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66980720a0 con 0x7f669815f2b0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.546+0000 7f6696ffd640 1 -- 172.21.15.132:0/1095250499 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 282751547 0 0) 0x7f6698071de0 con 0x7f66981443e0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.547+0000 7f66977fe640 1 --2- 172.21.15.132:0/1095250499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669815f2b0 0x7f66980cd660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66980c88a0 tx=0x7f668c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1d76daa25677b58 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.547+0000 7f6696ffd640 1 -- 172.21.15.132:0/1095250499 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c037070 con 0x7f669815f2b0 2024-04-25T12:50:51.548 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.547+0000 7f6696ffd640 1 -- 172.21.15.132:0/1095250499 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c032440 con 0x7f669815f2b0 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.547+0000 7f6696ffd640 1 -- 172.21.15.132:0/1095250499 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c032810 con 0x7f669815f2b0 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.547+0000 7f669e885640 1 -- 172.21.15.132:0/1095250499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669815f2b0 msgr2=0x7f66980cd660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.547+0000 7f669e885640 1 --2- 172.21.15.132:0/1095250499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669815f2b0 0x7f66980cd660 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f66980c88a0 tx=0x7f668c02a1a0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.548+0000 7f669e885640 1 -- 172.21.15.132:0/1095250499 shutdown_connections 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.548+0000 7f669e885640 1 --2- 172.21.15.132:0/1095250499 >> v2:172.21.15.157:3300/0 conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.548+0000 7f669e885640 1 --2- 172.21.15.132:0/1095250499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669815f2b0 0x7f66980cd660 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.548+0000 7f669e885640 1 -- 172.21.15.132:0/1095250499 >> 172.21.15.132:0/1095250499 conn(0x7f6698075d50 msgr2=0x7f669806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.548+0000 7f669e885640 1 -- 172.21.15.132:0/1095250499 shutdown_connections 2024-04-25T12:50:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.548+0000 7f669e885640 1 -- 172.21.15.132:0/1095250499 wait complete. 2024-04-25T12:50:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.549+0000 7f669e885640 1 Processor -- start 2024-04-25T12:50:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.549+0000 7f669e885640 1 -- start start 2024-04-25T12:50:51.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 0x7f66981e6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669815f2b0 0x7f66981e6fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6698072940 con 0x7f66981443e0 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6698072660 con 0x7f669815f2b0 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f66981447c0 con 0x7f66980cdba0 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 0x7f66981e6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 0x7f66981e6a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51898/0 (socket says 172.21.15.132:51898) 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 -- 172.21.15.132:0/3061368068 learned_addr learned my addr 172.21.15.132:0/3061368068 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669ce22640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669815f2b0 0x7f66981e6fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f6697fff640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 -- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66980cdba0 msgr2=0x7f669815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 -- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669815f2b0 msgr2=0x7f66981e6fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669815f2b0 0x7f66981e6fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 -- 172.21.15.132:0/3061368068 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6698158100 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f6697fff640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f66977fe640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 0x7f66981e6a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f668c000c00 tx=0x7f668c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c037040 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f668c042070 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f668c030bd0 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f669815edc0 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.550+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f669813f360 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.551+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f669806edd0 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.552+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f668c047460 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.552+0000 7f6694ff9640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f668406c920 0x7f668406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.552+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f668c0ac920 con 0x7f66981443e0 2024-04-25T12:50:51.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.552+0000 7f6697fff640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f668406c920 0x7f668406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:51.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.552+0000 7f6697fff640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f668406c920 0x7f668406ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f60 tx=0x7f6688007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:51.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.556+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f669806edd0 con 0x7f66981443e0 2024-04-25T12:50:51.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.767+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6698068c20 con 0x7f66981443e0 2024-04-25T12:50:51.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.768+0000 7f6694ff9640 1 -- 172.21.15.132:0/3061368068 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6841 (secure 0 0 0) 0x7f668c032e20 con 0x7f66981443e0 2024-04-25T12:50:51.766 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:51.767 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:40.764315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:50:51.767 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2024-04-25T12:50:51.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f668406c920 msgr2=0x7f668406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f668406c920 0x7f668406ede0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6688000f60 tx=0x7f6688007c10 comp rx=0 tx=0).stop 2024-04-25T12:50:51.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 msgr2=0x7f66981e6a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:51.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 0x7f66981e6a90 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f668c000c00 tx=0x7f668c0046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 shutdown_connections 2024-04-25T12:50:51.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f668406c920 0x7f668406ede0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f669815f2b0 0x7f66981e6fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66981443e0 0x7f66981e6a90 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 --2- 172.21.15.132:0/3061368068 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f66980cdba0 0x7f669815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:51.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 >> 172.21.15.132:0/3061368068 conn(0x7f6698075d50 msgr2=0x7f6698143470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:51.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 shutdown_connections 2024-04-25T12:50:51.770 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:51.770+0000 7f669e885640 1 -- 172.21.15.132:0/3061368068 wait complete. 2024-04-25T12:50:52.384 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 9, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T12:50:12.686402+0000', 'modified': '2024-04-25T12:50:40.764315+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4296}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4296': {'gid': 4296, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.157:6837/2805783268', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.157:6836', 'nonce': 2805783268}, {'type': 'v1', 'addr': '172.21.15.157:6837', 'nonce': 2805783268}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4296, 'qdb_cluster': [4296]} 2024-04-25T12:50:52.384 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T12:50:52.384 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-25T12:50:52.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.488+0000 7f62b3c35640 1 Processor -- start 2024-04-25T12:50:52.486 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.488+0000 7f62b3c35640 1 -- start start 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b3c35640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62ac152e00 0x7f62ac073680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b3c35640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac1531e0 0x7f62ac073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b3c35640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62ac1590f0 con 0x7f62ac0c96c0 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b3c35640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f62ac1593d0 con 0x7f62ac152e00 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b3c35640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac1596b0 con 0x7f62ac1531e0 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b21d2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f62ac0c96c0 0x7f62ac15c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56216/0 (socket says 172.21.15.132:56216) 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b21d2640 1 -- 172.21.15.132:0/366089712 learned_addr learned my addr 172.21.15.132:0/366089712 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b19d1640 1 --2- 172.21.15.132:0/366089712 >> v2:172.21.15.157:3300/0 conn(0x7f62ac152e00 0x7f62ac073680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b11d0640 1 --2- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac1531e0 0x7f62ac073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.489 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b09cf640 1 -- 172.21.15.132:0/366089712 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960404087 0 0) 0x7f62ac1590f0 con 0x7f62ac0c96c0 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b09cf640 1 -- 172.21.15.132:0/366089712 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6294003520 con 0x7f62ac0c96c0 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b09cf640 1 -- 172.21.15.132:0/366089712 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3318698102 0 0) 0x7f6294003520 con 0x7f62ac0c96c0 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b19d1640 1 -- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac1531e0 msgr2=0x7f62ac073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b19d1640 1 --2- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac1531e0 0x7f62ac073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b19d1640 1 -- 172.21.15.132:0/366089712 >> v1:172.21.15.132:6789/0 conn(0x7f62ac0c96c0 legacy=0x7f62ac15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.489+0000 7f62b19d1640 1 -- 172.21.15.132:0/366089712 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac159990 con 0x7f62ac152e00 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.490+0000 7f62b19d1640 1 --2- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac073680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f629c009dc0 tx=0x7f629c02a6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cd9361cdd7aa12e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.490+0000 7f62b09cf640 1 -- 172.21.15.132:0/366089712 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4001670 con 0x7f62ac152e00 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.490+0000 7f62b09cf640 1 -- 172.21.15.132:0/366089712 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c007540 con 0x7f62ac152e00 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.490+0000 7f62b09cf640 1 -- 172.21.15.132:0/366089712 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c0076f0 con 0x7f62ac152e00 2024-04-25T12:50:52.490 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 -- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 msgr2=0x7f62ac073680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 --2- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac073680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f629c009dc0 tx=0x7f629c02a6a0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 -- 172.21.15.132:0/366089712 shutdown_connections 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 --2- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac1531e0 0x7f62ac073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 --2- 172.21.15.132:0/366089712 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac073680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 -- 172.21.15.132:0/366089712 >> 172.21.15.132:0/366089712 conn(0x7f62ac067630 msgr2=0x7f62ac067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 -- 172.21.15.132:0/366089712 shutdown_connections 2024-04-25T12:50:52.491 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.491+0000 7f62b3c35640 1 -- 172.21.15.132:0/366089712 wait complete. 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 Processor -- start 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 -- start start 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac0c96c0 0x7f62ac1f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac14b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 0x7f62ac155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0c7ca0 con 0x7f62ac1531e0 2024-04-25T12:50:52.497 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac0c8d00 con 0x7f62ac152e00 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.492+0000 7f62b3c35640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f62ac1f3200 con 0x7f62ac0c96c0 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 0x7f62ac155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 0x7f62ac155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53904/0 (socket says 172.21.15.132:53904) 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 -- 172.21.15.132:0/2597536976 learned_addr learned my addr 172.21.15.132:0/2597536976 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b11d0640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac14b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac0c96c0 0x7f62ac1f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 -- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac0c96c0 msgr2=0x7f62ac1f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac0c96c0 0x7f62ac1f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 -- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 msgr2=0x7f62ac14b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac14b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 -- 172.21.15.132:0/2597536976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62ac0cc6f0 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac0c96c0 0x7f62ac1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b21d2640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 0x7f62ac155b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f62a400c520 tx=0x7f62a400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62aa7fc640 1 -- 172.21.15.132:0/2597536976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a4017070 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62aa7fc640 1 -- 172.21.15.132:0/2597536976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f62a4005ce0 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62ac153d10 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62aa7fc640 1 -- 172.21.15.132:0/2597536976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a40072b0 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.493+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62ac0ccc70 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.495+0000 7f62aa7fc640 1 -- 172.21.15.132:0/2597536976 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f62a401a070 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.495+0000 7f62aa7fc640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f629806c8f0 0x7f629806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.495+0000 7f62aa7fc640 1 -- 172.21.15.132:0/2597536976 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f62a408b1f0 con 0x7f62ac1531e0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.495+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f629806c8f0 0x7f629806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.495+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f629806c8f0 0x7f629806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f629c034000 tx=0x7f629c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.496+0000 7f62b6a2b740 1 Processor -- start 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.496+0000 7f62b6a2b740 1 -- start start 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce465da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4618fc0 0x561ce461cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce46678a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561ce4582c50 con 0x561ce4619690 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561ce451f830 con 0x561ce4618fc0 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561ce457ec10 con 0x561ce4619a70 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce465da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce465da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53906/0 (socket says 172.21.15.132:53906) 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 -- 172.21.15.132:0/4086954589 learned_addr learned my addr 172.21.15.132:0/4086954589 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b11d0640 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4618fc0 0x561ce461cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.500 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b21d2640 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce46678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 -- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 msgr2=0x561ce46678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce46678a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 -- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4618fc0 msgr2=0x561ce461cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4618fc0 0x561ce461cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 -- 172.21.15.132:0/4086954589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce42952d0 con 0x561ce4619690 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62b19d1640 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce465da90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f629c0077b0 tx=0x7f629c02e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a32e29234a6781b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.497+0000 7f62937fe640 1 -- 172.21.15.132:0/4086954589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c04d070 con 0x561ce4619690 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62937fe640 1 -- 172.21.15.132:0/4086954589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c052460 con 0x561ce4619690 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62937fe640 1 -- 172.21.15.132:0/4086954589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c052810 con 0x561ce4619690 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 -- 172.21.15.132:0/4086954589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 msgr2=0x561ce465da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce465da90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f629c0077b0 tx=0x7f629c02e000 comp rx=0 tx=0).stop 2024-04-25T12:50:52.501 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 -- 172.21.15.132:0/4086954589 shutdown_connections 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce46678a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4618fc0 0x561ce461cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/4086954589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce465da90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 -- 172.21.15.132:0/4086954589 >> 172.21.15.132:0/4086954589 conn(0x561ce461ac80 msgr2=0x561ce461d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 -- 172.21.15.132:0/4086954589 shutdown_connections 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.498+0000 7f62b6a2b740 1 -- 172.21.15.132:0/4086954589 wait complete. 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.499+0000 7f62b6a2b740 1 -- start start 2024-04-25T12:50:52.502 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.499+0000 7f62b6a2b740 1 Processor -- start 2024-04-25T12:50:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4619690 0x561ce463a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce461e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 0x561ce461ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561ce465e700 con 0x561ce46473f0 2024-04-25T12:50:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561ce451d470 con 0x561ce4619690 2024-04-25T12:50:52.506 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561ce461c0e0 con 0x561ce4619a70 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 10 client.0 _ll_register_callbacks cb 0x561ce4542f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 0x561ce461ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 0x561ce461ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53914/0 (socket says 172.21.15.132:53914) 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 -- 172.21.15.132:0/2089441523 learned_addr learned my addr 172.21.15.132:0/2089441523 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4619690 0x561ce463a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b11d0640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce461e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 -- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 msgr2=0x561ce461e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce461e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 -- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4619690 msgr2=0x561ce463a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4619690 0x561ce463a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 -- 172.21.15.132:0/2089441523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce435f6b0 con 0x561ce46473f0 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b21d2640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 0x561ce461ebc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005880 tx=0x7f62a4058da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf28ce65236c6b1d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.507 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f6290ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f6290ff9640 1 -- 172.21.15.132:0/2089441523 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a40613c0 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f6290ff9640 1 -- 172.21.15.132:0/2089441523 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f62a4061560 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f629c052460 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.500+0000 7f6290ff9640 1 -- 172.21.15.132:0/2089441523 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f62a4089120 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 10 client.4845 fetch_fsmap learned FSMap version 9 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561ce4672730 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f6290ff9640 1 -- 172.21.15.132:0/2089441523 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c052460 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f6290ff9640 1 -- 172.21.15.132:0/2089441523 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f62a4007450 con 0x561ce46473f0 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 10 client.4845 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 10 client.4845 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 20 client.4845 populate_metadata read hostname 'smithi132' 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce463e600 0x561ce467e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.508 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 4 client.4845 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 --> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561ce4590670 con 0x561ce463e600 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce463e600 0x561ce467e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f6290ff9640 10 client.4845 ms_handle_connect on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.501+0000 7f62b19d1640 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce463e600 0x561ce467e3c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1fe934aa8f5d1cd1 server_cookie=c70810d9a8f78804 in_seq=0 out_seq=0 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f6290ff9640 1 -- 172.21.15.132:0/2089441523 <== mds.0 v2:172.21.15.157:6836/2805783268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x561ce4590670 con 0x561ce463e600 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f6290ff9640 10 client.4845 handle_command_reply: tid=0 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 client.4845 shutdown 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 msgr2=0x561ce461ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 0x561ce461ebc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f62a4005880 tx=0x7f62a4058da0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 shutdown_connections 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce463e600 0x561ce467e3c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce46473f0 0x561ce461ebc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce461e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/2089441523 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce4619690 0x561ce463a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f6290ff9640 0 client.4845 ms_handle_reset on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.502+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 >> 172.21.15.132:0/2089441523 conn(0x561ce4618fc0 msgr2=0x561ce4618240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.503+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 shutdown_connections 2024-04-25T12:50:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.503+0000 7f62b6a2b740 1 -- 172.21.15.132:0/2089441523 wait complete. 2024-04-25T12:50:52.510 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.503+0000 7f62b6a2b740 20 client.4845 trim_cache size 0 max 16384 2024-04-25T12:50:52.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 Processor -- start 2024-04-25T12:50:52.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 -- start start 2024-04-25T12:50:52.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce46d1ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce463c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce463ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac151290 con 0x561ce4619690 2024-04-25T12:50:52.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f62ac1fb660 con 0x561ce46473f0 2024-04-25T12:50:52.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561ce4645400 con 0x561ce4619a70 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.521+0000 7f62b19d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce46d1ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce46d1ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53928/0 (socket says 172.21.15.132:53928) 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 -- 172.21.15.132:0/1322036935 learned_addr learned my addr 172.21.15.132:0/1322036935 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b21d2640 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce463ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b11d0640 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce463c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 -- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 msgr2=0x561ce463c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce463c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 -- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 msgr2=0x561ce463ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce463ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 -- 172.21.15.132:0/1322036935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561ce465d5e0 con 0x561ce4619690 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f62b19d1640 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce46d1ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f629c02ac90 tx=0x7f629c02c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0ce9f683771de7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f6292ffd640 1 -- 172.21.15.132:0/1322036935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c04d040 con 0x561ce4619690 2024-04-25T12:50:52.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f6292ffd640 1 -- 172.21.15.132:0/1322036935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c053240 con 0x561ce4619690 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.522+0000 7f6292ffd640 1 -- 172.21.15.132:0/1322036935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f629c05f410 con 0x561ce4619690 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1322036935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 msgr2=0x561ce46d1ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce46d1ca0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f629c02ac90 tx=0x7f629c02c000 comp rx=0 tx=0).stop 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1322036935 shutdown_connections 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce463ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619a70 0x561ce463c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1322036935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619690 0x561ce46d1ca0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1322036935 >> 172.21.15.132:0/1322036935 conn(0x561ce4618fc0 msgr2=0x561ce463f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1322036935 shutdown_connections 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1322036935 wait complete. 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 -- start start 2024-04-25T12:50:52.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.523+0000 7f62b6a2b740 1 Processor -- start 2024-04-25T12:50:52.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619690 0x561ce4662b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.527 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 0x561ce4617a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce465ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x561ce463ea80 con 0x561ce4619a70 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x561ce4660f70 con 0x561ce46473f0 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x561ce463f130 con 0x561ce4619690 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b6a2b740 10 client.0 _ll_register_callbacks cb 0x7f62a4005f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 0x561ce4617a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 0x561ce4617a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53932/0 (socket says 172.21.15.132:53932) 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 -- 172.21.15.132:0/1483432886 learned_addr learned my addr 172.21.15.132:0/1483432886 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b19d1640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619690 0x561ce4662b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b21d2640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce465ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 -- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619690 msgr2=0x561ce4662b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619690 0x561ce4662b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 -- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 msgr2=0x561ce465ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.528 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce465ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.524+0000 7f62b11d0640 1 -- 172.21.15.132:0/1483432886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561ce463ddb0 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b11d0640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 0x561ce4617a40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0cb350 tx=0x7f62a0018820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38fa56d892cea1d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f6290ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f6290ff9640 1 -- 172.21.15.132:0/1483432886 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62a0016670 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f6290ff9640 1 -- 172.21.15.132:0/1483432886 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f62a0016810 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f629c053240 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f6290ff9640 1 -- 172.21.15.132:0/1483432886 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=9) ==== 24+0+0 (secure 0 0 0) 0x7f62a0016a10 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 10 client.4851 fetch_fsmap learned FSMap version 9 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=9,monmap=2+}) -- 0x561ce465e7a0 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f6290ff9640 1 -- 172.21.15.132:0/1483432886 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f629c053240 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f6290ff9640 1 -- 172.21.15.132:0/1483432886 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 9) ==== 4712+0+0 (secure 0 0 0) 0x7f62a0029050 con 0x561ce4619a70 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 10 client.4851 fetch_fsmap finished waiting for FSMap version 9 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 10 client.4851 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 20 client.4851 populate_metadata read hostname 'smithi132' 2024-04-25T12:50:52.529 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce46de260 0x561ce46e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 4 client.4851 mds_command: new command op to 4296 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 --> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] -- command(tid 0: {"prefix": "status"}) -- 0x561ce458a4e0 con 0x561ce46de260 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.525+0000 7f62b19d1640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce46de260 0x561ce46e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f6290ff9640 10 client.4851 ms_handle_connect on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b19d1640 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce46de260 0x561ce46e6be0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b6be70d046dc4b8 server_cookie=769cf18b98f9f6bc in_seq=0 out_seq=0 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f6290ff9640 1 -- 172.21.15.132:0/1483432886 <== mds.0 v2:172.21.15.157:6836/2805783268 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x561ce458a4e0 con 0x561ce46de260 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f6290ff9640 10 client.4851 handle_command_reply: tid=0 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 client.4851 shutdown 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 msgr2=0x561ce4617a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 0x561ce4617a40 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f62ac0cb350 tx=0x7f62a0018820 comp rx=0 tx=0).stop 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 shutdown_connections 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:6836/2805783268,v1:172.21.15.157:6837/2805783268] conn(0x561ce46de260 0x561ce46e6be0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.530 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x561ce46473f0 0x561ce465ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f6290ff9640 0 client.4851 ms_handle_reset on v2:172.21.15.157:6836/2805783268 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x561ce4619a70 0x561ce4617a40 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 --2- 172.21.15.132:0/1483432886 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x561ce4619690 0x561ce4662b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 >> 172.21.15.132:0/1483432886 conn(0x561ce4618fc0 msgr2=0x561ce46d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 shutdown_connections 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 1 -- 172.21.15.132:0/1483432886 wait complete. 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.526+0000 7f62b6a2b740 20 client.4851 trim_cache size 0 max 16384 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:50:52.531 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "5bda364d-1418-47e5-9931-4f49e5bffd9b", 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4296, 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 39.175170905999998, 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 9, 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 25, 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 25, 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 45.768874230000002 2024-04-25T12:50:52.532 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f629806c8f0 msgr2=0x7f629806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f629806c8f0 0x7f629806edb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f629c034000 tx=0x7f629c02f000 comp rx=0 tx=0).stop 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 msgr2=0x7f62ac155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 0x7f62ac155b10 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f62a400c520 tx=0x7f62a400c9e0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 shutdown_connections 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f629806c8f0 0x7f629806edb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62ac1531e0 0x7f62ac155b10 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f62ac152e00 0x7f62ac14b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 --2- 172.21.15.132:0/2597536976 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f62ac0c96c0 0x7f62ac1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 >> 172.21.15.132:0/2597536976 conn(0x7f62ac067630 msgr2=0x7f62ac070cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 shutdown_connections 2024-04-25T12:50:52.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.527+0000 7f62b3c35640 1 -- 172.21.15.132:0/2597536976 wait complete. 2024-04-25T12:50:52.536 INFO:teuthology.run_tasks:Running task sequential... 2024-04-25T12:50:52.547 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-25T12:50:52.547 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-25T12:50:52.548 INFO:teuthology.task.print:Enabling mgr modules 2024-04-25T12:50:52.548 INFO:teuthology.run_tasks:Running task kclient... 2024-04-25T12:50:52.566 INFO:tasks.kclient:Mounting kernel clients... 2024-04-25T12:50:52.566 INFO:tasks.kclient:config is {'client.0': {}} 2024-04-25T12:50:52.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:52.566 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-25T12:50:52.581 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-25T12:50:52.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:52.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-25T12:50:52.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:52.645 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2024-04-25T12:50:52.741 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-04-25T12:50:52.741 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T12:50:52.741 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T12:50:52.741 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T12:50:52.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.841+0000 7fb0e0308640 1 Processor -- start 2024-04-25T12:50:52.839 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.841+0000 7fb0e0308640 1 -- start start 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.841+0000 7fb0e0308640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb0d8152380 0x7fb0d8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.841+0000 7fb0e0308640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d80c4cc0 0x7fb0d815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0e0308640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0d815b500 con 0x7fb0d8151fa0 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0e0308640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb0d815bae0 con 0x7fb0d8152380 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0e0308640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d80c52f0 con 0x7fb0d80c4cc0 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0de0a4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb0d8151fa0 0x7fb0d80c8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56228/0 (socket says 172.21.15.132:56228) 2024-04-25T12:50:52.842 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0de0a4640 1 -- 172.21.15.132:0/4070333736 learned_addr learned my addr 172.21.15.132:0/4070333736 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd8a3640 1 --2- 172.21.15.132:0/4070333736 >> v2:172.21.15.132:3300/0 conn(0x7fb0d8152380 0x7fb0d8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0de8a5640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d80c4cc0 0x7fb0d815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd0a2640 1 -- 172.21.15.132:0/4070333736 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1864806266 0 0) 0x7fb0d815b500 con 0x7fb0d8151fa0 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd0a2640 1 -- 172.21.15.132:0/4070333736 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0c4003520 con 0x7fb0d8151fa0 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/4070333736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d80c4cc0 msgr2=0x7fb0d815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd8a3640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d80c4cc0 0x7fb0d815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/4070333736 >> v1:172.21.15.132:6789/0 conn(0x7fb0d8151fa0 legacy=0x7fb0d80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/4070333736 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d80c55d0 con 0x7fb0d8152380 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.842+0000 7fb0de8a5640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d80c4cc0 0x7fb0d815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0dd8a3640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8152380 0x7fb0d8157e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80097a0 tx=0x7fb0c802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=341f0dfd75237c8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0dd0a2640 1 -- 172.21.15.132:0/4070333736 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8037070 con 0x7fb0d8152380 2024-04-25T12:50:52.843 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0dd0a2640 1 -- 172.21.15.132:0/4070333736 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c8032440 con 0x7fb0d8152380 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0dd0a2640 1 -- 172.21.15.132:0/4070333736 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8032810 con 0x7fb0d8152380 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 -- 172.21.15.132:0/4070333736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8152380 msgr2=0x7fb0d8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8152380 0x7fb0d8157e70 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb0c80097a0 tx=0x7fb0c802a180 comp rx=0 tx=0).stop 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 -- 172.21.15.132:0/4070333736 shutdown_connections 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d80c4cc0 0x7fb0d815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 --2- 172.21.15.132:0/4070333736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8152380 0x7fb0d8157e70 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 -- 172.21.15.132:0/4070333736 >> 172.21.15.132:0/4070333736 conn(0x7fb0d8067630 msgr2=0x7fb0d8067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.843+0000 7fb0e0308640 1 -- 172.21.15.132:0/4070333736 shutdown_connections 2024-04-25T12:50:52.844 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.844+0000 7fb0e0308640 1 -- 172.21.15.132:0/4070333736 wait complete. 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 Processor -- start 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 -- start start 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0d80c4cc0 0x7fb0d81f1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 0x7fb0d814ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d8152380 0x7fb0d8155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d80c3bc0 con 0x7fb0d8151fa0 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d80c58b0 con 0x7fb0d80c4cc0 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0e0308640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb0d80c9150 con 0x7fb0d8152380 2024-04-25T12:50:52.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0dd8a3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 0x7fb0d814ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0dd8a3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 0x7fb0d814ea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53954/0 (socket says 172.21.15.132:53954) 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.845+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/615934878 learned_addr learned my addr 172.21.15.132:0/615934878 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0de0a4640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0d80c4cc0 0x7fb0d81f1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0de8a5640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d8152380 0x7fb0d8155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d8152380 msgr2=0x7fb0d8155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0dd8a3640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d8152380 0x7fb0d8155ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0d80c4cc0 msgr2=0x7fb0d81f1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0dd8a3640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0d80c4cc0 0x7fb0d81f1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0dd8a3640 1 -- 172.21.15.132:0/615934878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d81f18d0 con 0x7fb0d8151fa0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0de0a4640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0d80c4cc0 0x7fb0d81f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0dd8a3640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 0x7fb0d814ea90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8035040 tx=0x7fb0c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8037040 con 0x7fb0d8151fa0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0c8030500 con 0x7fb0d8151fa0 2024-04-25T12:50:52.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0c8030910 con 0x7fb0d8151fa0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d806e610 con 0x7fb0d8151fa0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.846+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d806ebd0 con 0x7fb0d8151fa0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.847+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d8068c20 con 0x7fb0d8151fa0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.847+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb0c8044020 con 0x7fb0d8151fa0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.848+0000 7fb0ceffd640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.848+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb0c80ac130 con 0x7fb0d8151fa0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.848+0000 7fb0de0a4640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:52.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.848+0000 7fb0de0a4640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4005880 tx=0x7fb0d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:52.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:52.852+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb0d81f18d0 con 0x7fb0d8151fa0 2024-04-25T12:50:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.062+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb0d8155820 con 0x7fb0d8151fa0 2024-04-25T12:50:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.063+0000 7fb0ceffd640 1 -- 172.21.15.132:0/615934878 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v9) ==== 53+0+88 (secure 0 0 0) 0x7fb0c807a220 con 0x7fb0d8151fa0 2024-04-25T12:50:53.061 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-25T12:50:53.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb0bc06c8f0 msgr2=0x7fb0bc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:53.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4005880 tx=0x7fb0d4009040 comp rx=0 tx=0).stop 2024-04-25T12:50:53.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 msgr2=0x7fb0d814ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:53.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 0x7fb0d814ea90 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb0c8035040 tx=0x7fb0c80046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:53.063 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 shutdown_connections 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb0bc06c8f0 0x7fb0bc06edb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb0d8152380 0x7fb0d8155ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0d8151fa0 0x7fb0d814ea90 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 --2- 172.21.15.132:0/615934878 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb0d80c4cc0 0x7fb0d81f1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 >> 172.21.15.132:0/615934878 conn(0x7fb0d8067630 msgr2=0x7fb0d80caeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 shutdown_connections 2024-04-25T12:50:53.064 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53.065+0000 7fb0e0308640 1 -- 172.21.15.132:0/615934878 wait complete. 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T12:50:53.074 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T12:50:53.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:53.074 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2024-04-25T12:50:53.089 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T12:50:53.089 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T12:50:53.090 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2024-04-25T12:50:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T12:50:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42651sec preferred_lft 42651sec 2024-04-25T12:50:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::d0a2:2792:ed08:58a3/64 scope link noprefixroute 2024-04-25T12:50:53.091 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2024-04-25T12:50:53.091 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T12:50:53.091 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:53.177 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:53.217 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:53.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:53.225 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T12:50:53.246 INFO:teuthology.orchestra.run.smithi132.stdout:1 2024-04-25T12:50:53.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:53.248 DEBUG:teuthology.orchestra.run.smithi132:> route 2024-04-25T12:50:53.304 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2024-04-25T12:50:53.305 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T12:50:53.305 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T12:50:53.305 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T12:50:53.305 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T12:50:53.305 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:53.305 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:53.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T12:50:53.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T12:50:53.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T12:50:53.305 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:53.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:53.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:53.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:53.429 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-25T12:50:53.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:53.444 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2024-04-25T12:50:53.499 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:53.499 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:53.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:50:53.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T12:50:53.499 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:53.613 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T12:50:53.613 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:53.661 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:53.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:53.721 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T12:50:53.721 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2024-04-25T12:50:53.721 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2024-04-25T12:50:53.722 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T12:50:53.722 DEBUG:teuthology.orchestra.run.smithi132:> ') 2024-04-25T12:50:53.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:53.790 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:53.796 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:50:53.796 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T12:50:53.817 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T12:50:53.817 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T12:50:53.817 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T12:50:53.872 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-04-25T12:50:53.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:53.872 DEBUG:teuthology.orchestra.run.smithi132:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T12:50:53.954 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T12:50:53.954 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: resolved to: "172.21.15.132:3300,172.21.15.157:3300,172.21.15.157:3301" 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: trying mount with new device syntax: 0@5bda364d-1418-47e5-9931-4f49e5bffd9b.cephfs=/ 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.132:3300/172.21.15.157:3300/172.21.15.157:3301" will pass to kernel 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-04-25T12:50:54.074 INFO:teuthology.orchestra.run.smithi132.stdout: You just mounted a file system that supports labels which does not 2024-04-25T12:50:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-04-25T12:50:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: applications will generate AVC messages and not be allowed access to 2024-04-25T12:50:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-04-25T12:50:54.076 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-04-25T12:50:54.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:54.076 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T12:50:54.140 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T12:50:54.229 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T12:50:54.231 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:54.237 INFO:teuthology.orchestra.run.smithi132.stdout:client4607 2024-04-25T12:50:54.237 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:50:54.237 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:50:54.254 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T12:50:54.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T12:50:54.343 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:54.349 INFO:teuthology.orchestra.run.smithi132.stdout:client4607 2024-04-25T12:50:54.349 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-04-25T12:50:54.397 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-25T12:50:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:54.404 INFO:teuthology.orchestra.run.smithi132.stdout:client4607 2024-04-25T12:50:54.404 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/5bda364d-1418-47e5-9931-4f49e5bffd9b.client4607/status') 2024-04-25T12:50:54.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T12:50:54.461 INFO:teuthology.orchestra.run.smithi132.stdout:instance: client.4607 (3)172.21.15.132:0/1144329745 2024-04-25T12:50:54.461 INFO:teuthology.orchestra.run.smithi132.stdout:blocklisted: false 2024-04-25T12:50:54.461 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2024-04-25T12:50:54.461 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2024-04-25T12:50:54.461 INFO:teuthology.orchestra.run.smithi132.stderr:71 bytes copied, 2.1169e-05 s, 3.4 MB/s 2024-04-25T12:50:54.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T12:50:54.468 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-25T12:50:54.481 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T12:50:54.723 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=46ef4c0b59d445439e9d0344fe9d72ac Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph_4d7908725372ec8e17504b848bfa122dd1d43386/qa/tasks/quiescer.py", line 387, in task cluster_name = config.get('cluster', 'ceph') AttributeError: 'NoneType' object has no attribute 'get' 2024-04-25T12:50:54.724 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-25T12:50:54.733 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-04-25T12:50:54.742 INFO:tasks.kclient:Unmounting kernel clients... 2024-04-25T12:50:54.742 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:50:54.742 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:50:54.762 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2024-04-25T12:50:54.762 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T12:50:54.817 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:54.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 Processor -- start 2024-04-25T12:50:54.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 -- start start 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78f015c550 0x7f78f00c4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f0159a20 0x7f78f00cd660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78f00682d0 con 0x7f78f00c9940 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f78f00c48d0 con 0x7f78f015c550 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.957+0000 7f78f4831640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f78f0158f60 con 0x7f78f0159a20 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78f015c550 0x7f78f00c4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:54.957 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78f015c550 0x7f78f00c4bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53964/0 (socket says 172.21.15.132:53964) 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 -- 172.21.15.132:0/3698482686 learned_addr learned my addr 172.21.15.132:0/3698482686 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78eed9d640 1 --2- 172.21.15.132:0/3698482686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f0159a20 0x7f78f00cd660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 -- 172.21.15.132:0/3698482686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f0159a20 msgr2=0x7f78f00cd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 --2- 172.21.15.132:0/3698482686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f0159a20 0x7f78f00cd660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 -- 172.21.15.132:0/3698482686 >> v1:172.21.15.157:6789/0 conn(0x7f78f00c9940 legacy=0x7f78f0067bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.958+0000 7f78e7fff640 1 -- 172.21.15.132:0/3698482686 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f00c5210 con 0x7f78f015c550 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78e7fff640 1 --2- 172.21.15.132:0/3698482686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f015c550 0x7f78f00c4bd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009870 tx=0x7f78d802a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5e861f31f75ff5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78edd9b640 1 -- 172.21.15.132:0/3698482686 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8037070 con 0x7f78f015c550 2024-04-25T12:50:54.958 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78edd9b640 1 -- 172.21.15.132:0/3698482686 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78d8032440 con 0x7f78f015c550 2024-04-25T12:50:54.959 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78edd9b640 1 -- 172.21.15.132:0/3698482686 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78d8032810 con 0x7f78f015c550 2024-04-25T12:50:54.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 -- 172.21.15.132:0/3698482686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f015c550 msgr2=0x7f78f00c4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:54.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 --2- 172.21.15.132:0/3698482686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f015c550 0x7f78f00c4bd0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f78d8009870 tx=0x7f78d802a210 comp rx=0 tx=0).stop 2024-04-25T12:50:54.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 -- 172.21.15.132:0/3698482686 shutdown_connections 2024-04-25T12:50:54.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 --2- 172.21.15.132:0/3698482686 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f0159a20 0x7f78f00cd660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:54.962 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 --2- 172.21.15.132:0/3698482686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f015c550 0x7f78f00c4bd0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 -- 172.21.15.132:0/3698482686 >> 172.21.15.132:0/3698482686 conn(0x7f78f0075d50 msgr2=0x7f78f006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 -- 172.21.15.132:0/3698482686 shutdown_connections 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.959+0000 7f78f4831640 1 -- 172.21.15.132:0/3698482686 wait complete. 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 Processor -- start 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 -- start start 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 0x7f78f00726f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78f0159a20 0x7f78f00c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f015c550 0x7f78f00ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:54.963 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78f0159220 con 0x7f78f00c9940 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f78f00c57d0 con 0x7f78f0159a20 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78f4831640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f78f0159500 con 0x7f78f015c550 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 0x7f78f00726f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78ee59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 0x7f78f00726f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53974/0 (socket says 172.21.15.132:53974) 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.961+0000 7f78ee59c640 1 -- 172.21.15.132:0/689269121 learned_addr learned my addr 172.21.15.132:0/689269121 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78eed9d640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f015c550 0x7f78f00ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78e7fff640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78f0159a20 0x7f78f00c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78ee59c640 1 -- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f015c550 msgr2=0x7f78f00ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78ee59c640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f015c550 0x7f78f00ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78ee59c640 1 -- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78f0159a20 msgr2=0x7f78f00c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78ee59c640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78f0159a20 0x7f78f00c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78ee59c640 1 -- 172.21.15.132:0/689269121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f01f4770 con 0x7f78f00c9940 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78ee59c640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 0x7f78f00726f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78e000b420 tx=0x7f78e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0011830 con 0x7f78f00c9940 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78e0016070 con 0x7f78f00c9940 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f00cb9d0 con 0x7f78f00c9940 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78e0011c10 con 0x7f78f00c9940 2024-04-25T12:50:54.965 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.962+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f00cbf90 con 0x7f78f00c9940 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.963+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f00c9d20 con 0x7f78f00c9940 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.963+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78e001b460 con 0x7f78f00c9940 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.964+0000 7f78e6ffd640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78d006c8f0 0x7f78d006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.964+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f78e008bbd0 con 0x7f78f00c9940 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.964+0000 7f78e7fff640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78d006c8f0 0x7f78d006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.964+0000 7f78e7fff640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78d006c8f0 0x7f78d006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78d8034000 tx=0x7f78d802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:54.966 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:54.968+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f78f00c9d20 con 0x7f78f00c9940 2024-04-25T12:50:55.141 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.143+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78f006f320 con 0x7f78f00c9940 2024-04-25T12:50:55.143 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.145+0000 7f78e6ffd640 1 -- 172.21.15.132:0/689269121 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18985 (secure 0 0 0) 0x7f78f006f320 con 0x7f78f00c9940 2024-04-25T12:50:55.143 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:55.143 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":27,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:54.470996+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:55.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78d006c8f0 msgr2=0x7f78d006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.145 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78d006c8f0 0x7f78d006edb0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f78d8034000 tx=0x7f78d802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 msgr2=0x7f78f00726f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 0x7f78f00726f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f78e000b420 tx=0x7f78e000b8e0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 shutdown_connections 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78d006c8f0 0x7f78d006edb0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78f015c550 0x7f78f00ccb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78f0159a20 0x7f78f00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.146 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 --2- 172.21.15.132:0/689269121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78f00c9940 0x7f78f00726f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 >> 172.21.15.132:0/689269121 conn(0x7f78f0075d50 msgr2=0x7f78f006f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:55.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 shutdown_connections 2024-04-25T12:50:55.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.147+0000 7f78f4831640 1 -- 172.21.15.132:0/689269121 wait complete. 2024-04-25T12:50:55.156 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T12:50:01.141124+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T12:50:11.154024+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T12:50:11.639000+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-25T12:50:15.365379+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T12:50:55.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T12:50:55.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.259+0000 7ff55ed36640 1 Processor -- start 2024-04-25T12:50:55.258 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.259+0000 7ff55ed36640 1 -- start start 2024-04-25T12:50:55.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55ed36640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5581534f0 0x7ff55815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55ed36640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ff5580cbcb0 0x7ff5580c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55ed36640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5581538d0 con 0x7ff558072ea0 2024-04-25T12:50:55.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55ed36640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ff558159130 con 0x7ff5581534f0 2024-04-25T12:50:55.260 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55ed36640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ff5580c6670 con 0x7ff5580cbcb0 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5581534f0 0x7ff55815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5581534f0 0x7ff55815c6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53990/0 (socket says 172.21.15.132:53990) 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 -- 172.21.15.132:0/3661398649 learned_addr learned my addr 172.21.15.132:0/3661398649 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff557fff640 1 --2- 172.21.15.132:0/3661398649 >> v2:172.21.15.157:3300/0 conn(0x7ff5580cbcb0 0x7ff5580c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 -- 172.21.15.132:0/3661398649 >> v2:172.21.15.157:3300/0 conn(0x7ff5580cbcb0 msgr2=0x7ff5580c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 --2- 172.21.15.132:0/3661398649 >> v2:172.21.15.157:3300/0 conn(0x7ff5580cbcb0 0x7ff5580c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 -- 172.21.15.132:0/3661398649 >> v1:172.21.15.157:6789/0 conn(0x7ff558072ea0 legacy=0x7ff5580ce8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.261 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.260+0000 7ff55cad2640 1 -- 172.21.15.132:0/3661398649 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5580c6950 con 0x7ff5581534f0 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.261+0000 7ff55cad2640 1 --2- 172.21.15.132:0/3661398649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff55815c6a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff5580718d0 tx=0x7ff54802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b067b352114dfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.261+0000 7ff5577fe640 1 -- 172.21.15.132:0/3661398649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548037070 con 0x7ff5581534f0 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.261+0000 7ff5577fe640 1 -- 172.21.15.132:0/3661398649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff548032440 con 0x7ff5581534f0 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.261+0000 7ff5577fe640 1 -- 172.21.15.132:0/3661398649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff548032810 con 0x7ff5581534f0 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 -- 172.21.15.132:0/3661398649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 msgr2=0x7ff55815c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 --2- 172.21.15.132:0/3661398649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff55815c6a0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff5580718d0 tx=0x7ff54802a1e0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 -- 172.21.15.132:0/3661398649 shutdown_connections 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 --2- 172.21.15.132:0/3661398649 >> v2:172.21.15.157:3300/0 conn(0x7ff5580cbcb0 0x7ff5580c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.262 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 --2- 172.21.15.132:0/3661398649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff55815c6a0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 -- 172.21.15.132:0/3661398649 >> 172.21.15.132:0/3661398649 conn(0x7ff558070a90 msgr2=0x7ff558070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:55.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 -- 172.21.15.132:0/3661398649 shutdown_connections 2024-04-25T12:50:55.263 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.262+0000 7ff55ed36640 1 -- 172.21.15.132:0/3661398649 wait complete. 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.263+0000 7ff55ed36640 1 Processor -- start 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.263+0000 7ff55ed36640 1 -- start start 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff558072ea0 0x7ff55815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5580cbcb0 0x7ff5580ceb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff558150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ff55815cbe0 con 0x7ff5581534f0 2024-04-25T12:50:55.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ff5581596d0 con 0x7ff5580cbcb0 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ff5580c8cb0 con 0x7ff558072ea0 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff558150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff558150f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54004/0 (socket says 172.21.15.132:54004) 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 -- 172.21.15.132:0/1706906999 learned_addr learned my addr 172.21.15.132:0/1706906999 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff557fff640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5580cbcb0 0x7ff5580ceb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55cad2640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff558072ea0 0x7ff55815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 -- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff558072ea0 msgr2=0x7ff55815baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff558072ea0 0x7ff55815baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 -- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5580cbcb0 msgr2=0x7ff5580ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5580cbcb0 0x7ff5580ceb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 -- 172.21.15.132:0/1706906999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff55815c660 con 0x7ff5581534f0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55d2d3640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff558150f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c6e0 tx=0x7ff55000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550003b70 con 0x7ff5581534f0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff550003d30 con 0x7ff5581534f0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.264+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff55815c940 con 0x7ff5581534f0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.265+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff550005310 con 0x7ff5581534f0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.265+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5580cae70 con 0x7ff5581534f0 2024-04-25T12:50:55.268 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.266+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5580ca9c0 con 0x7ff5581534f0 2024-04-25T12:50:55.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.266+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff5500054b0 con 0x7ff5581534f0 2024-04-25T12:50:55.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.266+0000 7ff5557fa640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff54406c8f0 0x7ff54406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.267+0000 7ff55cad2640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff54406c8f0 0x7ff54406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.267+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ff55008bde0 con 0x7ff5581534f0 2024-04-25T12:50:55.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.267+0000 7ff55cad2640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff54406c8f0 0x7ff54406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff548034000 tx=0x7ff54802e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.269 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.271+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff550059df0 con 0x7ff5581534f0 2024-04-25T12:50:55.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.445+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff5580c78e0 con 0x7ff5581534f0 2024-04-25T12:50:55.443 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.445+0000 7ff5557fa640 1 -- 172.21.15.132:0/1706906999 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) ==== 93+0+10 (secure 0 0 0) 0x7ff5580c78e0 con 0x7ff5581534f0 2024-04-25T12:50:55.443 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2024-04-25T12:50:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff54406c8f0 msgr2=0x7ff54406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.445 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff54406c8f0 0x7ff54406edb0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff548034000 tx=0x7ff54802e000 comp rx=0 tx=0).stop 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 msgr2=0x7ff558150f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff558150f20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff55000c6e0 tx=0x7ff55000cba0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 shutdown_connections 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ff54406c8f0 0x7ff54406edb0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5581534f0 0x7ff558150f20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ff5580cbcb0 0x7ff5580ceb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 --2- 172.21.15.132:0/1706906999 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ff558072ea0 0x7ff55815baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 >> 172.21.15.132:0/1706906999 conn(0x7ff558070a90 msgr2=0x7ff5580cc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 shutdown_connections 2024-04-25T12:50:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.447+0000 7ff55ed36640 1 -- 172.21.15.132:0/1706906999 wait complete. 2024-04-25T12:50:55.456 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T12:50:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.558+0000 7f6a8d34f640 1 Processor -- start 2024-04-25T12:50:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.558+0000 7f6a8d34f640 1 -- start start 2024-04-25T12:50:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a8d34f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 0x7f6a8815bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a8d34f640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a880cc4d0 0x7f6a880c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a8d34f640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a880c5ba0 con 0x7f6a880cc910 2024-04-25T12:50:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a8d34f640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f6a880c5e60 con 0x7f6a880cc4d0 2024-04-25T12:50:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a8d34f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a8815c130 con 0x7f6a88155660 2024-04-25T12:50:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a86ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 0x7f6a8815bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a867fc640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6a880cc4d0 0x7f6a880c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a86ffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 0x7f6a8815bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:56184/0 (socket says 172.21.15.132:56184) 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a877fe640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f6a880cc910 0x7f6a8806c370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:48618/0 (socket says 172.21.15.132:48618) 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.559+0000 7f6a86ffd640 1 -- 172.21.15.132:0/1727775682 learned_addr learned my addr 172.21.15.132:0/1727775682 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.560+0000 7f6a86ffd640 1 -- 172.21.15.132:0/1727775682 >> v2:172.21.15.157:3300/0 conn(0x7f6a880cc4d0 msgr2=0x7f6a880c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.560+0000 7f6a86ffd640 1 --2- 172.21.15.132:0/1727775682 >> v2:172.21.15.157:3300/0 conn(0x7f6a880cc4d0 0x7f6a880c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.560+0000 7f6a86ffd640 1 -- 172.21.15.132:0/1727775682 >> v1:172.21.15.157:6789/0 conn(0x7f6a880cc910 legacy=0x7f6a8806c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.560+0000 7f6a85ffb640 1 -- 172.21.15.132:0/1727775682 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1115411897 0 0) 0x7f6a880c5ba0 con 0x7f6a880cc910 2024-04-25T12:50:55.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.560+0000 7f6a86ffd640 1 -- 172.21.15.132:0/1727775682 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8815e850 con 0x7f6a88155660 2024-04-25T12:50:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a86ffd640 1 --2- 172.21.15.132:0/1727775682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 0x7f6a8815bbf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009e50 tx=0x7f6a7802a710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcea01781a68896d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a85ffb640 1 -- 172.21.15.132:0/1727775682 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a78036070 con 0x7f6a88155660 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a85ffb640 1 -- 172.21.15.132:0/1727775682 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a78031600 con 0x7f6a88155660 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a85ffb640 1 -- 172.21.15.132:0/1727775682 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a780319d0 con 0x7f6a88155660 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1727775682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 msgr2=0x7f6a8815bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1727775682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 0x7f6a8815bbf0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6a78009e50 tx=0x7f6a7802a710 comp rx=0 tx=0).stop 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1727775682 shutdown_connections 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1727775682 >> v2:172.21.15.157:3300/0 conn(0x7f6a880cc4d0 0x7f6a880c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1727775682 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a88155660 0x7f6a8815bbf0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1727775682 >> 172.21.15.132:0/1727775682 conn(0x7f6a88073350 msgr2=0x7f6a88067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1727775682 shutdown_connections 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.561+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1727775682 wait complete. 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 Processor -- start 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 -- start start 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a880cc4d0 0x7f6a8815daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a880cc910 0x7f6a88159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 0x7f6a8815a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8815f0f0 con 0x7f6a88155660 2024-04-25T12:50:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6a8815ee10 con 0x7f6a880cc4d0 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a8d34f640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6a880cb7c0 con 0x7f6a880cc910 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 0x7f6a8815a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 0x7f6a8815a700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54014/0 (socket says 172.21.15.132:54014) 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.563+0000 7f6a877fe640 1 -- 172.21.15.132:0/1936025481 learned_addr learned my addr 172.21.15.132:0/1936025481 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a867fc640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a880cc910 0x7f6a88159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a86ffd640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a880cc4d0 0x7f6a8815daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a877fe640 1 -- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a880cc910 msgr2=0x7f6a88159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a877fe640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a880cc910 0x7f6a88159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a877fe640 1 -- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a880cc4d0 msgr2=0x7f6a8815daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a877fe640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a880cc4d0 0x7f6a8815daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a877fe640 1 -- 172.21.15.132:0/1936025481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a8815e450 con 0x7f6a88155660 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a877fe640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 0x7f6a8815a700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c430 tx=0x7f6a8000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a800074e0 con 0x7f6a88155660 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a800047e0 con 0x7f6a88155660 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a881f4330 con 0x7f6a88155660 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80004bd0 con 0x7f6a88155660 2024-04-25T12:50:55.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.564+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a881f48f0 con 0x7f6a88155660 2024-04-25T12:50:55.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.565+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a8815a3d0 con 0x7f6a88155660 2024-04-25T12:50:55.568 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.565+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a80011070 con 0x7f6a88155660 2024-04-25T12:50:55.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.566+0000 7f6a6f7fe640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a7406c8f0 0x7f6a7406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.566+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6a8008bb00 con 0x7f6a88155660 2024-04-25T12:50:55.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.566+0000 7f6a86ffd640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a7406c8f0 0x7f6a7406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.566+0000 7f6a86ffd640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a7406c8f0 0x7f6a7406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a78033000 tx=0x7f6a78009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.569 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.570+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a80059500 con 0x7f6a88155660 2024-04-25T12:50:55.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.741+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6a88068d00 con 0x7f6a88155660 2024-04-25T12:50:55.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.742+0000 7f6a6f7fe640 1 -- 172.21.15.132:0/1936025481 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) ==== 104+0+11 (secure 0 0 0) 0x7f6a8005d800 con 0x7f6a88155660 2024-04-25T12:50:55.740 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a7406c8f0 msgr2=0x7f6a7406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a7406c8f0 0x7f6a7406edb0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f6a78033000 tx=0x7f6a78009000 comp rx=0 tx=0).stop 2024-04-25T12:50:55.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 msgr2=0x7f6a8815a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 0x7f6a8815a700 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000c430 tx=0x7f6a8000c8f0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 shutdown_connections 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6a7406c8f0 0x7f6a7406edb0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a88155660 0x7f6a8815a700 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6a880cc910 0x7f6a88159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 --2- 172.21.15.132:0/1936025481 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6a880cc4d0 0x7f6a8815daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 >> 172.21.15.132:0/1936025481 conn(0x7f6a88073350 msgr2=0x7f6a880c5fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:55.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 shutdown_connections 2024-04-25T12:50:55.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.744+0000 7f6a8d34f640 1 -- 172.21.15.132:0/1936025481 wait complete. 2024-04-25T12:50:55.753 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T12:50:55.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.854+0000 7f4210274640 1 Processor -- start 2024-04-25T12:50:55.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.854+0000 7f4210274640 1 -- start start 2024-04-25T12:50:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.855+0000 7f4210274640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4208153190 0x7f4208073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.855+0000 7f4210274640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 0x7f42080c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.855+0000 7f4210274640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42081591b0 con 0x7f42080c7330 2024-04-25T12:50:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.855+0000 7f4210274640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f42080cc4e0 con 0x7f4208153190 2024-04-25T12:50:55.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.855+0000 7f4210274640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f4208159450 con 0x7f42080c6f50 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 0x7f42080c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 0x7f42080c5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:56196/0 (socket says 172.21.15.132:56196) 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420e010640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f4208153190 0x7f4208073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 -- 172.21.15.132:0/1493098444 learned_addr learned my addr 172.21.15.132:0/1493098444 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 -- 172.21.15.132:0/1493098444 >> v2:172.21.15.157:3300/0 conn(0x7f4208153190 msgr2=0x7f4208073bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 --2- 172.21.15.132:0/1493098444 >> v2:172.21.15.157:3300/0 conn(0x7f4208153190 0x7f4208073bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 -- 172.21.15.132:0/1493098444 >> v1:172.21.15.157:6789/0 conn(0x7f42080c7330 legacy=0x7f42080cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420d80f640 1 -- 172.21.15.132:0/1493098444 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4208158ee0 con 0x7f42080c6f50 2024-04-25T12:50:55.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.856+0000 7f420e010640 1 --2- 172.21.15.132:0/1493098444 >> v2:172.21.15.157:3300/0 conn(0x7f4208153190 0x7f4208073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:55.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.857+0000 7f420d80f640 1 --2- 172.21.15.132:0/1493098444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 0x7f42080c5c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009870 tx=0x7f41f802a300 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e3be1d3e1e02a8a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.857+0000 7f420d00e640 1 -- 172.21.15.132:0/1493098444 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8037070 con 0x7f42080c6f50 2024-04-25T12:50:55.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.857+0000 7f420d00e640 1 -- 172.21.15.132:0/1493098444 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f802ae50 con 0x7f42080c6f50 2024-04-25T12:50:55.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.857+0000 7f420d00e640 1 -- 172.21.15.132:0/1493098444 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8032860 con 0x7f42080c6f50 2024-04-25T12:50:55.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 -- 172.21.15.132:0/1493098444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 msgr2=0x7f42080c5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 --2- 172.21.15.132:0/1493098444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 0x7f42080c5c60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f41f8009870 tx=0x7f41f802a300 comp rx=0 tx=0).stop 2024-04-25T12:50:55.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 -- 172.21.15.132:0/1493098444 shutdown_connections 2024-04-25T12:50:55.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 --2- 172.21.15.132:0/1493098444 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c6f50 0x7f42080c5c60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 --2- 172.21.15.132:0/1493098444 >> v2:172.21.15.157:3300/0 conn(0x7f4208153190 0x7f4208073bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.861 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 -- 172.21.15.132:0/1493098444 >> 172.21.15.132:0/1493098444 conn(0x7f4208075db0 msgr2=0x7f4208067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 -- 172.21.15.132:0/1493098444 shutdown_connections 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.858+0000 7f4210274640 1 -- 172.21.15.132:0/1493098444 wait complete. 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.859+0000 7f4210274640 1 Processor -- start 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.859+0000 7f4210274640 1 -- start start 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f4210274640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42080c6f50 0x7f42080cb530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f4210274640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 0x7f42080cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f4210274640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 0x7f42081e3910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.862 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f4210274640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f4208159cd0 con 0x7f4208153190 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f4210274640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f42081599f0 con 0x7f42080c6f50 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f4210274640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f42080cd0d0 con 0x7f42080c7330 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420e811640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 0x7f42081e3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 0x7f42080cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420e010640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42080c6f50 0x7f42080cb530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 0x7f42080cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:56204/0 (socket says 172.21.15.132:56204) 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 -- 172.21.15.132:0/2869708461 learned_addr learned my addr 172.21.15.132:0/2869708461 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:55.863 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420e811640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 0x7f42081e3910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54024/0 (socket says 172.21.15.132:54024) 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 -- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42080c6f50 msgr2=0x7f42080cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42080c6f50 0x7f42080cb530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 -- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 msgr2=0x7f42081e3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 0x7f42081e3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 -- 172.21.15.132:0/2869708461 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4208151ac0 con 0x7f42080c7330 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420e811640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 0x7f42081e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.860+0000 7f420d80f640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 0x7f42080cba70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f41f802a340 tx=0x7f41f80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.864 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.861+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8041020 con 0x7f42080c7330 2024-04-25T12:50:55.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.861+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41f803c870 con 0x7f42080c7330 2024-04-25T12:50:55.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.861+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f8037040 con 0x7f42080c7330 2024-04-25T12:50:55.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.861+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4208151d60 con 0x7f42080c7330 2024-04-25T12:50:55.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.861+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4208152300 con 0x7f42080c7330 2024-04-25T12:50:55.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.862+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4208068d00 con 0x7f42080c7330 2024-04-25T12:50:55.865 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.862+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f41f8044020 con 0x7f42080c7330 2024-04-25T12:50:55.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.862+0000 7f41feffd640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f41ec06c8f0 0x7f41ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:55.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.863+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f41f80ac7f0 con 0x7f42080c7330 2024-04-25T12:50:55.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.863+0000 7f420e010640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f41ec06c8f0 0x7f41ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:55.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.863+0000 7f420e010640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f41ec06c8f0 0x7f41ec06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4200009bd0 tx=0x7f420000b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:55.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:55.868+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f41f804b030 con 0x7f42080c7330 2024-04-25T12:50:56.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.041+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f420815d370 con 0x7f42080c7330 2024-04-25T12:50:56.041 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.042+0000 7f41feffd640 1 -- 172.21.15.132:0/2869708461 <== mon.2 v2:172.21.15.157:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) ==== 100+0+11 (secure 0 0 0) 0x7f41f807a110 con 0x7f42080c7330 2024-04-25T12:50:56.041 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2024-04-25T12:50:56.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f41ec06c8f0 msgr2=0x7f41ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f41ec06c8f0 0x7f41ec06edb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4200009bd0 tx=0x7f420000b040 comp rx=0 tx=0).stop 2024-04-25T12:50:56.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 msgr2=0x7f42080cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 0x7f42080cba70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f41f802a340 tx=0x7f41f80046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 shutdown_connections 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f41ec06c8f0 0x7f41ec06edb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4208153190 0x7f42081e3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f42080c7330 0x7f42080cba70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 --2- 172.21.15.132:0/2869708461 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f42080c6f50 0x7f42080cb530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 >> 172.21.15.132:0/2869708461 conn(0x7f4208075db0 msgr2=0x7f4208070d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 shutdown_connections 2024-04-25T12:50:56.044 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.044+0000 7f4210274640 1 -- 172.21.15.132:0/2869708461 wait complete. 2024-04-25T12:50:56.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-25T12:50:56.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.155+0000 7fe4af820640 1 Processor -- start 2024-04-25T12:50:56.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.155+0000 7fe4af820640 1 -- start start 2024-04-25T12:50:56.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4af820640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe4a80cbcb0 0x7fe4a80c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4af820640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a8073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4af820640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4a81538d0 con 0x7fe4a81534f0 2024-04-25T12:50:56.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4af820640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe4a8159130 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4af820640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a80c6670 con 0x7fe4a8072ea0 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4acdbb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe4a80cbcb0 0x7fe4a80c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4ad5bc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe4a81534f0 0x7fe4a815c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56234/0 (socket says 172.21.15.132:56234) 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4ad5bc640 1 -- 172.21.15.132:0/3337975060 learned_addr learned my addr 172.21.15.132:0/3337975060 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4addbd640 1 --2- 172.21.15.132:0/3337975060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a8073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4acdbb640 1 -- 172.21.15.132:0/3337975060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 msgr2=0x7fe4a8073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4acdbb640 1 --2- 172.21.15.132:0/3337975060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a8073310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4acdbb640 1 -- 172.21.15.132:0/3337975060 >> v1:172.21.15.132:6789/0 conn(0x7fe4a81534f0 legacy=0x7fe4a815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe49ffff640 1 -- 172.21.15.132:0/3337975060 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590931605 0 0) 0x7fe4a81538d0 con 0x7fe4a81534f0 2024-04-25T12:50:56.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.156+0000 7fe4acdbb640 1 -- 172.21.15.132:0/3337975060 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a80c6950 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4acdbb640 1 --2- 172.21.15.132:0/3337975060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a80c5d50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe49802a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f7f995c865d5e42 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:56.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe49ffff640 1 -- 172.21.15.132:0/3337975060 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498037070 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe49ffff640 1 -- 172.21.15.132:0/3337975060 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe49802ae50 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe49ffff640 1 -- 172.21.15.132:0/3337975060 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498032660 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 -- 172.21.15.132:0/3337975060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 msgr2=0x7fe4a80c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 --2- 172.21.15.132:0/3337975060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a80c5d50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe49802a100 comp rx=0 tx=0).stop 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 -- 172.21.15.132:0/3337975060 shutdown_connections 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 --2- 172.21.15.132:0/3337975060 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a8073310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 --2- 172.21.15.132:0/3337975060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a80c5d50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 -- 172.21.15.132:0/3337975060 >> 172.21.15.132:0/3337975060 conn(0x7fe4a8070a90 msgr2=0x7fe4a8070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.157+0000 7fe4af820640 1 -- 172.21.15.132:0/3337975060 shutdown_connections 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.158+0000 7fe4af820640 1 -- 172.21.15.132:0/3337975060 wait complete. 2024-04-25T12:50:56.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 Processor -- start 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 -- start start 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a81f2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a813e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a81534f0 0x7fe4a813e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a80c8cb0 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe4a81596d0 con 0x7fe4a81534f0 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4af820640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe4a8159ed0 con 0x7fe4a8072ea0 2024-04-25T12:50:56.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4acdbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a813e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4acdbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a813e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54042/0 (socket says 172.21.15.132:54042) 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.159+0000 7fe4acdbb640 1 -- 172.21.15.132:0/1337928501 learned_addr learned my addr 172.21.15.132:0/1337928501 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4acdbb640 1 -- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 msgr2=0x7fe4a81f2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4addbd640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a81534f0 0x7fe4a813e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4acdbb640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a81f2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4acdbb640 1 -- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a81534f0 msgr2=0x7fe4a813e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4acdbb640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a81534f0 0x7fe4a813e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4acdbb640 1 -- 172.21.15.132:0/1337928501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4a81f3150 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4acdbb640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a813e1e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe4980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498037040 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe498004030 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe498004420 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4a80cd550 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.160+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4a8074420 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.161+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a8149fe0 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.162+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe498003610 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.162+0000 7fe49dffb640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe48c06c920 0x7fe48c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.162+0000 7fe4ad5bc640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe48c06c920 0x7fe48c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.162+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fe4980acca0 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.163+0000 7fe4ad5bc640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe48c06c920 0x7fe48c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4007fd0 tx=0x7fe4a4007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:56.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.167+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe4a8149fe0 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.339+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fe4a80700f0 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.338 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.339+0000 7fe49dffb640 1 -- 172.21.15.132:0/1337928501 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) ==== 103+0+11 (secure 0 0 0) 0x7fe4a80700f0 con 0x7fe4a80cbcb0 2024-04-25T12:50:56.339 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe48c06c920 msgr2=0x7fe48c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe48c06c920 0x7fe48c06ede0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe4a4007fd0 tx=0x7fe4a4007960 comp rx=0 tx=0).stop 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 msgr2=0x7fe4a813e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a813e1e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe4980097a0 tx=0x7fe4980046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 shutdown_connections 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe48c06c920 0x7fe48c06ede0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe4a81534f0 0x7fe4a813e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.341 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4a80cbcb0 0x7fe4a813e1e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 --2- 172.21.15.132:0/1337928501 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe4a8072ea0 0x7fe4a81f2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 >> 172.21.15.132:0/1337928501 conn(0x7fe4a8070a90 msgr2=0x7fe4a80c7fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:56.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 shutdown_connections 2024-04-25T12:50:56.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.341+0000 7fe4af820640 1 -- 172.21.15.132:0/1337928501 wait complete. 2024-04-25T12:50:56.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T12:50:56.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.449+0000 7f1734f9b640 1 Processor -- start 2024-04-25T12:50:56.449 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.449+0000 7f1734f9b640 1 -- start start 2024-04-25T12:50:56.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f1734f9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f173014fa40 0x7f17300c8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.451 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f1734f9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300c68a0 0x7f17300c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f1734f9b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1730158f20 con 0x7f17300ca3f0 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f1734f9b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f173014fe20 con 0x7f173014fa40 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f1734f9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f17301597f0 con 0x7f17300c68a0 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f172e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f173014fa40 0x7f17300c8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f172dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f17300ca3f0 0x7f173006f070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56250/0 (socket says 172.21.15.132:56250) 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.450+0000 7f172dd9b640 1 -- 172.21.15.132:0/1518903983 learned_addr learned my addr 172.21.15.132:0/1518903983 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172ed9d640 1 --2- 172.21.15.132:0/1518903983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300c68a0 0x7f17300c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172e59c640 1 -- 172.21.15.132:0/1518903983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300c68a0 msgr2=0x7f17300c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:56.452 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172e59c640 1 --2- 172.21.15.132:0/1518903983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300c68a0 0x7f17300c6d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172e59c640 1 -- 172.21.15.132:0/1518903983 >> v1:172.21.15.132:6789/0 conn(0x7f17300ca3f0 legacy=0x7f173006f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172e59c640 1 -- 172.21.15.132:0/1518903983 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17300c9620 con 0x7f173014fa40 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172d59a640 1 -- 172.21.15.132:0/1518903983 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525933167 0 0) 0x7f1720001110 con 0x7f17300ca3f0 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.451+0000 7f172e59c640 1 --2- 172.21.15.132:0/1518903983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173014fa40 0x7f17300c8d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f17240097a0 tx=0x7f172402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3e4e4b0a16ca38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f172d59a640 1 -- 172.21.15.132:0/1518903983 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724037070 con 0x7f173014fa40 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f172d59a640 1 -- 172.21.15.132:0/1518903983 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724032440 con 0x7f173014fa40 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f172d59a640 1 -- 172.21.15.132:0/1518903983 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724032810 con 0x7f173014fa40 2024-04-25T12:50:56.453 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 -- 172.21.15.132:0/1518903983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173014fa40 msgr2=0x7f17300c8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 --2- 172.21.15.132:0/1518903983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173014fa40 0x7f17300c8d90 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f17240097a0 tx=0x7f172402a210 comp rx=0 tx=0).stop 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 -- 172.21.15.132:0/1518903983 shutdown_connections 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 --2- 172.21.15.132:0/1518903983 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300c68a0 0x7f17300c6d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 --2- 172.21.15.132:0/1518903983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173014fa40 0x7f17300c8d90 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 -- 172.21.15.132:0/1518903983 >> 172.21.15.132:0/1518903983 conn(0x7f173006d770 msgr2=0x7f173006db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 -- 172.21.15.132:0/1518903983 shutdown_connections 2024-04-25T12:50:56.454 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.452+0000 7f1734f9b640 1 -- 172.21.15.132:0/1518903983 wait complete. 2024-04-25T12:50:56.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 Processor -- start 2024-04-25T12:50:56.457 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 -- start start 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 0x7f173015ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300ca3f0 0x7f17301f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f173014fa40 0x7f1730154f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1730159480 con 0x7f17300c68a0 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f17301591a0 con 0x7f173014fa40 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f1734f9b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f17300c92d0 con 0x7f17300ca3f0 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f172e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 0x7f173015ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f172e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 0x7f173015ac60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54054/0 (socket says 172.21.15.132:54054) 2024-04-25T12:50:56.458 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f172e59c640 1 -- 172.21.15.132:0/3413592922 learned_addr learned my addr 172.21.15.132:0/3413592922 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.454+0000 7f172dd9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300ca3f0 0x7f17301f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172ed9d640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f173014fa40 0x7f1730154f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172e59c640 1 -- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300ca3f0 msgr2=0x7f17301f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172e59c640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300ca3f0 0x7f17301f2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172e59c640 1 -- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f173014fa40 msgr2=0x7f1730154f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172e59c640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f173014fa40 0x7f1730154f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172e59c640 1 -- 172.21.15.132:0/3413592922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f173015a4d0 con 0x7f17300c68a0 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172ed9d640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f173014fa40 0x7f1730154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:50:56.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f172e59c640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 0x7f173015ac60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1724035040 tx=0x7f17240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724037040 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1724030770 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f173015a1f0 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1724030b40 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.455+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17301f32b0 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.456+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1730068c20 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.456+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1724044020 con 0x7f17300c68a0 2024-04-25T12:50:56.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.457+0000 7f171effd640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f171006c8f0 0x7f171006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:56.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.457+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f17240ac500 con 0x7f17300c68a0 2024-04-25T12:50:56.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.457+0000 7f172dd9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f171006c8f0 0x7f171006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:56.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.457+0000 7f172dd9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f171006c8f0 0x7f171006edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17300c4150 tx=0x7f1720007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:56.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.461+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1724032e20 con 0x7f17300c68a0 2024-04-25T12:50:56.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.648+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f17300cdd80 con 0x7f17300c68a0 2024-04-25T12:50:56.647 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.648+0000 7f171effd640 1 -- 172.21.15.132:0/3413592922 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f172407a480 con 0x7f17300c68a0 2024-04-25T12:50:56.647 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2024-04-25T12:50:56.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f171006c8f0 msgr2=0x7f171006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.649 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f171006c8f0 0x7f171006edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17300c4150 tx=0x7f1720007970 comp rx=0 tx=0).stop 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 msgr2=0x7f173015ac60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 0x7f173015ac60 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1724035040 tx=0x7f17240046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 shutdown_connections 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f171006c8f0 0x7f171006edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f173014fa40 0x7f1730154f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f17300ca3f0 0x7f17301f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 --2- 172.21.15.132:0/3413592922 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17300c68a0 0x7f173015ac60 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:56.650 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 >> 172.21.15.132:0/3413592922 conn(0x7f173006d770 msgr2=0x7f17300715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:56.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 shutdown_connections 2024-04-25T12:50:56.651 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:56.650+0000 7f1734f9b640 1 -- 172.21.15.132:0/3413592922 wait complete. 2024-04-25T12:50:56.660 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-04-25T12:50:56.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:56.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-04-25T12:50:56.687 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:50:56.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:56.688 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T12:50:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:56.743 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2024-04-25T12:50:56.798 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T12:50:56.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:56.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T12:50:56.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T12:50:56.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2024-04-25T12:50:56.959 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T12:50:56.968 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T12:50:56.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:57.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.066+0000 7efee7fbb640 1 Processor -- start 2024-04-25T12:50:57.065 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.066+0000 7efee7fbb640 1 -- start start 2024-04-25T12:50:57.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee7fbb640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7efee00cbe50 0x7efee015bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee7fbb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00cb290 con 0x7efee0070870 2024-04-25T12:50:57.069 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee7fbb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee015eaf0 con 0x7efee00c89e0 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee7fbb640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7efee00c8dc0 con 0x7efee00cbe50 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee6558640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7efee0070870 0x7efee0070cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56252/0 (socket says 172.21.15.132:56252) 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee6558640 1 -- 172.21.15.132:0/3772676146 learned_addr learned my addr 172.21.15.132:0/3772676146 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee5556640 1 --2- 172.21.15.132:0/3772676146 >> v2:172.21.15.157:3300/0 conn(0x7efee00cbe50 0x7efee015bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1859291888 0 0) 0x7efee00cb290 con 0x7efee0070870 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efecc003520 con 0x7efee0070870 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1035366514 0 0) 0x7efecc003520 con 0x7efee0070870 2024-04-25T12:50:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 >> v2:172.21.15.157:3300/0 conn(0x7efee00cbe50 msgr2=0x7efee015bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 --2- 172.21.15.132:0/3772676146 >> v2:172.21.15.157:3300/0 conn(0x7efee00cbe50 0x7efee015bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 >> v1:172.21.15.157:6789/0 conn(0x7efee00c89e0 legacy=0x7efee00cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee015edd0 con 0x7efee0070870 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7efed80019f0 con 0x7efee0070870 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 >> v1:172.21.15.132:6789/0 conn(0x7efee0070870 legacy=0x7efee0070cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efecc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efecc004800 0x7efecc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efecc0051c0 0x7efecc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efee00c8dc0 con 0x7efecc0039b0 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efecc00c070 con 0x7efecc004800 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.067+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efecc00c270 con 0x7efecc0051c0 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efecc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5556640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efecc004800 0x7efecc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee6558640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efecc0051c0 0x7efecc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 -- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efecc0051c0 msgr2=0x7efecc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efecc0051c0 0x7efecc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.072 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 -- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efecc004800 msgr2=0x7efecc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efecc004800 0x7efecc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 -- 172.21.15.132:0/3772676146 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc003520 con 0x7efecc0039b0 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee6558640 1 -- 172.21.15.132:0/3772676146 reap_dead start 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.068+0000 7efee5d57640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efecc003dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efedc001750 tx=0x7efecc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f6436427abd713a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc001370 con 0x7efecc0039b0 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc0052d0 con 0x7efecc0039b0 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee4d55640 1 -- 172.21.15.132:0/3772676146 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc02abc0 con 0x7efecc0039b0 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 -- 172.21.15.132:0/3772676146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 msgr2=0x7efecc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.073 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efecc003dd0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7efedc001750 tx=0x7efecc005830 comp rx=0 tx=0).stop 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 -- 172.21.15.132:0/3772676146 shutdown_connections 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 --2- 172.21.15.132:0/3772676146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efecc003dd0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 -- 172.21.15.132:0/3772676146 >> 172.21.15.132:0/3772676146 conn(0x7efee0072f10 msgr2=0x7efee0073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 -- 172.21.15.132:0/3772676146 shutdown_connections 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.069+0000 7efee7fbb640 1 -- 172.21.15.132:0/3772676146 wait complete. 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.070+0000 7efee7fbb640 1 Processor -- start 2024-04-25T12:50:57.074 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.070+0000 7efee7fbb640 1 -- start start 2024-04-25T12:50:57.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee7fbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efee0152a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee7fbb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee0158700 0x7efee01f4470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee7fbb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee0155be0 0x7efee0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee7fbb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7efee015f390 con 0x7efecc0039b0 2024-04-25T12:50:57.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee7fbb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7efee015e8a0 con 0x7efee0158700 2024-04-25T12:50:57.077 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee7fbb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7efee015f670 con 0x7efee0155be0 2024-04-25T12:50:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efee0152a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efee0152a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54072/0 (socket says 172.21.15.132:54072) 2024-04-25T12:50:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 -- 172.21.15.132:0/1173833814 learned_addr learned my addr 172.21.15.132:0/1173833814 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 -- 172.21.15.132:0/1173833814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee0155be0 msgr2=0x7efee0156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee0155be0 0x7efee0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 -- 172.21.15.132:0/1173833814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee0158700 msgr2=0x7efee01f4470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee0158700 0x7efee01f4470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 -- 172.21.15.132:0/1173833814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee0157a80 con 0x7efecc0039b0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.071+0000 7efee5d57640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efee0152a60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efedc02a570 tx=0x7efedc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.072+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc040030 con 0x7efecc0039b0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.072+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efedc02be50 con 0x7efecc0039b0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.072+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee01582e0 con 0x7efecc0039b0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.072+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc001370 con 0x7efecc0039b0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.072+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee0158000 con 0x7efecc0039b0 2024-04-25T12:50:57.079 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.073+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee0068c20 con 0x7efecc0039b0 2024-04-25T12:50:57.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.073+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7efedc043070 con 0x7efecc0039b0 2024-04-25T12:50:57.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.074+0000 7efed67fc640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efec406c920 0x7efec406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.074+0000 7efee5556640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efec406c920 0x7efec406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.074+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7efedc0ab730 con 0x7efecc0039b0 2024-04-25T12:50:57.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.074+0000 7efee5556640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efec406c920 0x7efec406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efed0006e80 tx=0x7efed0006df0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.080 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.078+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7efedc04b020 con 0x7efecc0039b0 2024-04-25T12:50:57.249 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.250+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efee015cb70 con 0x7efec406c920 2024-04-25T12:50:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.258+0000 7efed67fc640 1 -- 172.21.15.132:0/1173833814 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7efee015cb70 con 0x7efec406c920 2024-04-25T12:50:57.262 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efec406c920 msgr2=0x7efec406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efec406c920 0x7efec406ede0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7efed0006e80 tx=0x7efed0006df0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 msgr2=0x7efee0152a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efee0152a60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7efedc02a570 tx=0x7efedc001120 comp rx=0 tx=0).stop 2024-04-25T12:50:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 shutdown_connections 2024-04-25T12:50:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efec406c920 0x7efec406ede0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7efee0155be0 0x7efee0156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7efee0158700 0x7efee01f4470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 --2- 172.21.15.132:0/1173833814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efecc0039b0 0x7efee0152a60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 >> 172.21.15.132:0/1173833814 conn(0x7efee0072f10 msgr2=0x7efee00c6b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:57.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 shutdown_connections 2024-04-25T12:50:57.267 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.262+0000 7efee7fbb640 1 -- 172.21.15.132:0/1173833814 wait complete. 2024-04-25T12:50:57.272 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-25T12:50:57.136905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595264,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":325,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232084,"kb_used_data":3428,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742636,"statfs":{"total":773094113280,"available":772856459264,"internally_reserved":0,"allocated":3510272,"data_stored":2118012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001430"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479195+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:54.479195+0000","last_peered":"2024-04-25T12:50:54.479195+0000","last_clean":"2024-04-25T12:50:54.479195+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:54.479195+0000","last_undegraded":"2024-04-25T12:50:54.479195+0000","last_fullsized":"2024-04-25T12:50:54.479195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600202+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:54.600202+0000","last_peered":"2024-04-25T12:50:54.600202+0000","last_clean":"2024-04-25T12:50:54.600202+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:54.600202+0000","last_undegraded":"2024-04-25T12:50:54.600202+0000","last_fullsized":"2024-04-25T12:50:54.600202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599272+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:54.599272+0000","last_peered":"2024-04-25T12:50:54.599272+0000","last_clean":"2024-04-25T12:50:54.599272+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:54.599272+0000","last_undegraded":"2024-04-25T12:50:54.599272+0000","last_fullsized":"2024-04-25T12:50:54.599272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600386+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:54.600386+0000","last_peered":"2024-04-25T12:50:54.600386+0000","last_clean":"2024-04-25T12:50:54.600386+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:54.600386+0000","last_undegraded":"2024-04-25T12:50:54.600386+0000","last_fullsized":"2024-04-25T12:50:54.600386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602722+0000","last_change":"2024-04-25T12:50:54.602722+0000","last_active":"2024-04-25T12:50:54.602722+0000","last_peered":"2024-04-25T12:50:54.602722+0000","last_clean":"2024-04-25T12:50:54.602722+0000","last_became_active":"2024-04-25T12:50:54.602420+0000","last_became_peered":"2024-04-25T12:50:54.602420+0000","last_unstale":"2024-04-25T12:50:54.602722+0000","last_undegraded":"2024-04-25T12:50:54.602722+0000","last_fullsized":"2024-04-25T12:50:54.602722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:56.779821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477099+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:54.477099+0000","last_peered":"2024-04-25T12:50:54.477099+0000","last_clean":"2024-04-25T12:50:54.477099+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:54.477099+0000","last_undegraded":"2024-04-25T12:50:54.477099+0000","last_fullsized":"2024-04-25T12:50:54.477099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600037+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:54.600037+0000","last_peered":"2024-04-25T12:50:54.600037+0000","last_clean":"2024-04-25T12:50:54.600037+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:54.600037+0000","last_undegraded":"2024-04-25T12:50:54.600037+0000","last_fullsized":"2024-04-25T12:50:54.600037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479322+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:54.479322+0000","last_peered":"2024-04-25T12:50:54.479322+0000","last_clean":"2024-04-25T12:50:54.479322+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:54.479322+0000","last_undegraded":"2024-04-25T12:50:54.479322+0000","last_fullsized":"2024-04-25T12:50:54.479322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477511+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:54.477511+0000","last_peered":"2024-04-25T12:50:54.477511+0000","last_clean":"2024-04-25T12:50:54.477511+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:54.477511+0000","last_undegraded":"2024-04-25T12:50:54.477511+0000","last_fullsized":"2024-04-25T12:50:54.477511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599777+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:54.599777+0000","last_peered":"2024-04-25T12:50:54.599777+0000","last_clean":"2024-04-25T12:50:54.599777+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:54.599777+0000","last_undegraded":"2024-04-25T12:50:54.599777+0000","last_fullsized":"2024-04-25T12:50:54.599777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479735+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:54.479735+0000","last_peered":"2024-04-25T12:50:54.479735+0000","last_clean":"2024-04-25T12:50:54.479735+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:54.479735+0000","last_undegraded":"2024-04-25T12:50:54.479735+0000","last_fullsized":"2024-04-25T12:50:54.479735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477367+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:54.477367+0000","last_peered":"2024-04-25T12:50:54.477367+0000","last_clean":"2024-04-25T12:50:54.477367+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:54.477367+0000","last_undegraded":"2024-04-25T12:50:54.477367+0000","last_fullsized":"2024-04-25T12:50:54.477367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474699+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:54.474699+0000","last_peered":"2024-04-25T12:50:54.474699+0000","last_clean":"2024-04-25T12:50:54.474699+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:54.474699+0000","last_undegraded":"2024-04-25T12:50:54.474699+0000","last_fullsized":"2024-04-25T12:50:54.474699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599849+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:54.599849+0000","last_peered":"2024-04-25T12:50:54.599849+0000","last_clean":"2024-04-25T12:50:54.599849+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:54.599849+0000","last_undegraded":"2024-04-25T12:50:54.599849+0000","last_fullsized":"2024-04-25T12:50:54.599849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477799+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:54.477799+0000","last_peered":"2024-04-25T12:50:54.477799+0000","last_clean":"2024-04-25T12:50:54.477799+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:54.477799+0000","last_undegraded":"2024-04-25T12:50:54.477799+0000","last_fullsized":"2024-04-25T12:50:54.477799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600162+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:54.600162+0000","last_peered":"2024-04-25T12:50:54.600162+0000","last_clean":"2024-04-25T12:50:54.600162+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:54.600162+0000","last_undegraded":"2024-04-25T12:50:54.600162+0000","last_fullsized":"2024-04-25T12:50:54.600162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601620+0000","last_change":"2024-04-25T12:50:54.601620+0000","last_active":"2024-04-25T12:50:54.601620+0000","last_peered":"2024-04-25T12:50:54.601620+0000","last_clean":"2024-04-25T12:50:54.601620+0000","last_became_active":"2024-04-25T12:50:54.601163+0000","last_became_peered":"2024-04-25T12:50:54.601163+0000","last_unstale":"2024-04-25T12:50:54.601620+0000","last_undegraded":"2024-04-25T12:50:54.601620+0000","last_fullsized":"2024-04-25T12:50:54.601620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:02.679362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599233+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:54.599233+0000","last_peered":"2024-04-25T12:50:54.599233+0000","last_clean":"2024-04-25T12:50:54.599233+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:54.599233+0000","last_undegraded":"2024-04-25T12:50:54.599233+0000","last_fullsized":"2024-04-25T12:50:54.599233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600288+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:54.600288+0000","last_peered":"2024-04-25T12:50:54.600288+0000","last_clean":"2024-04-25T12:50:54.600288+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:54.600288+0000","last_undegraded":"2024-04-25T12:50:54.600288+0000","last_fullsized":"2024-04-25T12:50:54.600288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600400+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:54.600400+0000","last_peered":"2024-04-25T12:50:54.600400+0000","last_clean":"2024-04-25T12:50:54.600400+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:54.600400+0000","last_undegraded":"2024-04-25T12:50:54.600400+0000","last_fullsized":"2024-04-25T12:50:54.600400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478229+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:54.478229+0000","last_peered":"2024-04-25T12:50:54.478229+0000","last_clean":"2024-04-25T12:50:54.478229+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:54.478229+0000","last_undegraded":"2024-04-25T12:50:54.478229+0000","last_fullsized":"2024-04-25T12:50:54.478229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599368+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:54.599368+0000","last_peered":"2024-04-25T12:50:54.599368+0000","last_clean":"2024-04-25T12:50:54.599368+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:54.599368+0000","last_undegraded":"2024-04-25T12:50:54.599368+0000","last_fullsized":"2024-04-25T12:50:54.599368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478354+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:54.478354+0000","last_peered":"2024-04-25T12:50:54.478354+0000","last_clean":"2024-04-25T12:50:54.478354+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:54.478354+0000","last_undegraded":"2024-04-25T12:50:54.478354+0000","last_fullsized":"2024-04-25T12:50:54.478354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478968+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:54.478968+0000","last_peered":"2024-04-25T12:50:54.478968+0000","last_clean":"2024-04-25T12:50:54.478968+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:54.478968+0000","last_undegraded":"2024-04-25T12:50:54.478968+0000","last_fullsized":"2024-04-25T12:50:54.478968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475142+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:54.475142+0000","last_peered":"2024-04-25T12:50:54.475142+0000","last_clean":"2024-04-25T12:50:54.475142+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:54.475142+0000","last_undegraded":"2024-04-25T12:50:54.475142+0000","last_fullsized":"2024-04-25T12:50:54.475142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478073+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:54.478073+0000","last_peered":"2024-04-25T12:50:54.478073+0000","last_clean":"2024-04-25T12:50:54.478073+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:54.478073+0000","last_undegraded":"2024-04-25T12:50:54.478073+0000","last_fullsized":"2024-04-25T12:50:54.478073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600661+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:54.600661+0000","last_peered":"2024-04-25T12:50:54.600661+0000","last_clean":"2024-04-25T12:50:54.600661+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:54.600661+0000","last_undegraded":"2024-04-25T12:50:54.600661+0000","last_fullsized":"2024-04-25T12:50:54.600661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600151+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:54.600151+0000","last_peered":"2024-04-25T12:50:54.600151+0000","last_clean":"2024-04-25T12:50:54.600151+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:54.600151+0000","last_undegraded":"2024-04-25T12:50:54.600151+0000","last_fullsized":"2024-04-25T12:50:54.600151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.598907+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:54.598907+0000","last_peered":"2024-04-25T12:50:54.598907+0000","last_clean":"2024-04-25T12:50:54.598907+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:54.598907+0000","last_undegraded":"2024-04-25T12:50:54.598907+0000","last_fullsized":"2024-04-25T12:50:54.598907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600154+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:54.600154+0000","last_peered":"2024-04-25T12:50:54.600154+0000","last_clean":"2024-04-25T12:50:54.600154+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:54.600154+0000","last_undegraded":"2024-04-25T12:50:54.600154+0000","last_fullsized":"2024-04-25T12:50:54.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600170+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:54.600170+0000","last_peered":"2024-04-25T12:50:54.600170+0000","last_clean":"2024-04-25T12:50:54.600170+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:54.600170+0000","last_undegraded":"2024-04-25T12:50:54.600170+0000","last_fullsized":"2024-04-25T12:50:54.600170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478601+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:54.478601+0000","last_peered":"2024-04-25T12:50:54.478601+0000","last_clean":"2024-04-25T12:50:54.478601+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:54.478601+0000","last_undegraded":"2024-04-25T12:50:54.478601+0000","last_fullsized":"2024-04-25T12:50:54.478601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480012+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:54.480012+0000","last_peered":"2024-04-25T12:50:54.480012+0000","last_clean":"2024-04-25T12:50:54.480012+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:54.480012+0000","last_undegraded":"2024-04-25T12:50:54.480012+0000","last_fullsized":"2024-04-25T12:50:54.480012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600254+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:54.600254+0000","last_peered":"2024-04-25T12:50:54.600254+0000","last_clean":"2024-04-25T12:50:54.600254+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:54.600254+0000","last_undegraded":"2024-04-25T12:50:54.600254+0000","last_fullsized":"2024-04-25T12:50:54.600254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599823+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:54.599823+0000","last_peered":"2024-04-25T12:50:54.599823+0000","last_clean":"2024-04-25T12:50:54.599823+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:54.599823+0000","last_undegraded":"2024-04-25T12:50:54.599823+0000","last_fullsized":"2024-04-25T12:50:54.599823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477890+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:54.477890+0000","last_peered":"2024-04-25T12:50:54.477890+0000","last_clean":"2024-04-25T12:50:54.477890+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:54.477890+0000","last_undegraded":"2024-04-25T12:50:54.477890+0000","last_fullsized":"2024-04-25T12:50:54.477890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479691+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:54.479691+0000","last_peered":"2024-04-25T12:50:54.479691+0000","last_clean":"2024-04-25T12:50:54.479691+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:54.479691+0000","last_undegraded":"2024-04-25T12:50:54.479691+0000","last_fullsized":"2024-04-25T12:50:54.479691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599847+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:54.599847+0000","last_peered":"2024-04-25T12:50:54.599847+0000","last_clean":"2024-04-25T12:50:54.599847+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:54.599847+0000","last_undegraded":"2024-04-25T12:50:54.599847+0000","last_fullsized":"2024-04-25T12:50:54.599847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599531+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:54.599531+0000","last_peered":"2024-04-25T12:50:54.599531+0000","last_clean":"2024-04-25T12:50:54.599531+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:54.599531+0000","last_undegraded":"2024-04-25T12:50:54.599531+0000","last_fullsized":"2024-04-25T12:50:54.599531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476542+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:54.476542+0000","last_peered":"2024-04-25T12:50:54.476542+0000","last_clean":"2024-04-25T12:50:54.476542+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:54.476542+0000","last_undegraded":"2024-04-25T12:50:54.476542+0000","last_fullsized":"2024-04-25T12:50:54.476542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600495+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:54.600495+0000","last_peered":"2024-04-25T12:50:54.600495+0000","last_clean":"2024-04-25T12:50:54.600495+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:54.600495+0000","last_undegraded":"2024-04-25T12:50:54.600495+0000","last_fullsized":"2024-04-25T12:50:54.600495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478363+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:54.478363+0000","last_peered":"2024-04-25T12:50:54.478363+0000","last_clean":"2024-04-25T12:50:54.478363+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:54.478363+0000","last_undegraded":"2024-04-25T12:50:54.478363+0000","last_fullsized":"2024-04-25T12:50:54.478363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599446+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:54.599446+0000","last_peered":"2024-04-25T12:50:54.599446+0000","last_clean":"2024-04-25T12:50:54.599446+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:54.599446+0000","last_undegraded":"2024-04-25T12:50:54.599446+0000","last_fullsized":"2024-04-25T12:50:54.599446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601447+0000","last_change":"2024-04-25T12:50:54.601447+0000","last_active":"2024-04-25T12:50:54.601447+0000","last_peered":"2024-04-25T12:50:54.601447+0000","last_clean":"2024-04-25T12:50:54.601447+0000","last_became_active":"2024-04-25T12:50:54.601056+0000","last_became_peered":"2024-04-25T12:50:54.601056+0000","last_unstale":"2024-04-25T12:50:54.601447+0000","last_undegraded":"2024-04-25T12:50:54.601447+0000","last_fullsized":"2024-04-25T12:50:54.601447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:00.221828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599271+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:54.599271+0000","last_peered":"2024-04-25T12:50:54.599271+0000","last_clean":"2024-04-25T12:50:54.599271+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:54.599271+0000","last_undegraded":"2024-04-25T12:50:54.599271+0000","last_fullsized":"2024-04-25T12:50:54.599271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479375+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:54.479375+0000","last_peered":"2024-04-25T12:50:54.479375+0000","last_clean":"2024-04-25T12:50:54.479375+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:54.479375+0000","last_undegraded":"2024-04-25T12:50:54.479375+0000","last_fullsized":"2024-04-25T12:50:54.479375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599510+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:54.599510+0000","last_peered":"2024-04-25T12:50:54.599510+0000","last_clean":"2024-04-25T12:50:54.599510+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:54.599510+0000","last_undegraded":"2024-04-25T12:50:54.599510+0000","last_fullsized":"2024-04-25T12:50:54.599510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474978+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:54.474978+0000","last_peered":"2024-04-25T12:50:54.474978+0000","last_clean":"2024-04-25T12:50:54.474978+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:54.474978+0000","last_undegraded":"2024-04-25T12:50:54.474978+0000","last_fullsized":"2024-04-25T12:50:54.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599883+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:54.599883+0000","last_peered":"2024-04-25T12:50:54.599883+0000","last_clean":"2024-04-25T12:50:54.599883+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:54.599883+0000","last_undegraded":"2024-04-25T12:50:54.599883+0000","last_fullsized":"2024-04-25T12:50:54.599883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474733+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:54.474733+0000","last_peered":"2024-04-25T12:50:54.474733+0000","last_clean":"2024-04-25T12:50:54.474733+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:54.474733+0000","last_undegraded":"2024-04-25T12:50:54.474733+0000","last_fullsized":"2024-04-25T12:50:54.474733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479406+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:54.479406+0000","last_peered":"2024-04-25T12:50:54.479406+0000","last_clean":"2024-04-25T12:50:54.479406+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:54.479406+0000","last_undegraded":"2024-04-25T12:50:54.479406+0000","last_fullsized":"2024-04-25T12:50:54.479406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599921+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:54.599921+0000","last_peered":"2024-04-25T12:50:54.599921+0000","last_clean":"2024-04-25T12:50:54.599921+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:54.599921+0000","last_undegraded":"2024-04-25T12:50:54.599921+0000","last_fullsized":"2024-04-25T12:50:54.599921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478719+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:54.478719+0000","last_peered":"2024-04-25T12:50:54.478719+0000","last_clean":"2024-04-25T12:50:54.478719+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:54.478719+0000","last_undegraded":"2024-04-25T12:50:54.478719+0000","last_fullsized":"2024-04-25T12:50:54.478719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600500+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:54.600500+0000","last_peered":"2024-04-25T12:50:54.600500+0000","last_clean":"2024-04-25T12:50:54.600500+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:54.600500+0000","last_undegraded":"2024-04-25T12:50:54.600500+0000","last_fullsized":"2024-04-25T12:50:54.600500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476341+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:54.476341+0000","last_peered":"2024-04-25T12:50:54.476341+0000","last_clean":"2024-04-25T12:50:54.476341+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:54.476341+0000","last_undegraded":"2024-04-25T12:50:54.476341+0000","last_fullsized":"2024-04-25T12:50:54.476341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478904+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:54.478904+0000","last_peered":"2024-04-25T12:50:54.478904+0000","last_clean":"2024-04-25T12:50:54.478904+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:54.478904+0000","last_undegraded":"2024-04-25T12:50:54.478904+0000","last_fullsized":"2024-04-25T12:50:54.478904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600300+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:54.600300+0000","last_peered":"2024-04-25T12:50:54.600300+0000","last_clean":"2024-04-25T12:50:54.600300+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:54.600300+0000","last_undegraded":"2024-04-25T12:50:54.600300+0000","last_fullsized":"2024-04-25T12:50:54.600300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478701+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:54.478701+0000","last_peered":"2024-04-25T12:50:54.478701+0000","last_clean":"2024-04-25T12:50:54.478701+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:54.478701+0000","last_undegraded":"2024-04-25T12:50:54.478701+0000","last_fullsized":"2024-04-25T12:50:54.478701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602094+0000","last_change":"2024-04-25T12:50:54.602094+0000","last_active":"2024-04-25T12:50:54.602094+0000","last_peered":"2024-04-25T12:50:54.602094+0000","last_clean":"2024-04-25T12:50:54.602094+0000","last_became_active":"2024-04-25T12:50:54.601336+0000","last_became_peered":"2024-04-25T12:50:54.601336+0000","last_unstale":"2024-04-25T12:50:54.602094+0000","last_undegraded":"2024-04-25T12:50:54.602094+0000","last_fullsized":"2024-04-25T12:50:54.602094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:50.002160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.483087+0000","last_change":"2024-04-25T12:50:54.479164+0000","last_active":"2024-04-25T12:50:54.483087+0000","last_peered":"2024-04-25T12:50:54.483087+0000","last_clean":"2024-04-25T12:50:54.483087+0000","last_became_active":"2024-04-25T12:50:54.478889+0000","last_became_peered":"2024-04-25T12:50:54.478889+0000","last_unstale":"2024-04-25T12:50:54.483087+0000","last_undegraded":"2024-04-25T12:50:54.483087+0000","last_fullsized":"2024-04-25T12:50:54.483087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:51.351035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475987+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:54.475987+0000","last_peered":"2024-04-25T12:50:54.475987+0000","last_clean":"2024-04-25T12:50:54.475987+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:54.475987+0000","last_undegraded":"2024-04-25T12:50:54.475987+0000","last_fullsized":"2024-04-25T12:50:54.475987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478799+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:54.478799+0000","last_peered":"2024-04-25T12:50:54.478799+0000","last_clean":"2024-04-25T12:50:54.478799+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:54.478799+0000","last_undegraded":"2024-04-25T12:50:54.478799+0000","last_fullsized":"2024-04-25T12:50:54.478799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474617+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:54.474617+0000","last_peered":"2024-04-25T12:50:54.474617+0000","last_clean":"2024-04-25T12:50:54.474617+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:54.474617+0000","last_undegraded":"2024-04-25T12:50:54.474617+0000","last_fullsized":"2024-04-25T12:50:54.474617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474706+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:54.474706+0000","last_peered":"2024-04-25T12:50:54.474706+0000","last_clean":"2024-04-25T12:50:54.474706+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:54.474706+0000","last_undegraded":"2024-04-25T12:50:54.474706+0000","last_fullsized":"2024-04-25T12:50:54.474706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600491+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:54.600491+0000","last_peered":"2024-04-25T12:50:54.600491+0000","last_clean":"2024-04-25T12:50:54.600491+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:54.600491+0000","last_undegraded":"2024-04-25T12:50:54.600491+0000","last_fullsized":"2024-04-25T12:50:54.600491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599852+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:54.599852+0000","last_peered":"2024-04-25T12:50:54.599852+0000","last_clean":"2024-04-25T12:50:54.599852+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:54.599852+0000","last_undegraded":"2024-04-25T12:50:54.599852+0000","last_fullsized":"2024-04-25T12:50:54.599852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479586+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:54.479586+0000","last_peered":"2024-04-25T12:50:54.479586+0000","last_clean":"2024-04-25T12:50:54.479586+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:54.479586+0000","last_undegraded":"2024-04-25T12:50:54.479586+0000","last_fullsized":"2024-04-25T12:50:54.479586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599324+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:54.599324+0000","last_peered":"2024-04-25T12:50:54.599324+0000","last_clean":"2024-04-25T12:50:54.599324+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:54.599324+0000","last_undegraded":"2024-04-25T12:50:54.599324+0000","last_fullsized":"2024-04-25T12:50:54.599324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478503+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:54.478503+0000","last_peered":"2024-04-25T12:50:54.478503+0000","last_clean":"2024-04-25T12:50:54.478503+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:54.478503+0000","last_undegraded":"2024-04-25T12:50:54.478503+0000","last_fullsized":"2024-04-25T12:50:54.478503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478971+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:54.478971+0000","last_peered":"2024-04-25T12:50:54.478971+0000","last_clean":"2024-04-25T12:50:54.478971+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:54.478971+0000","last_undegraded":"2024-04-25T12:50:54.478971+0000","last_fullsized":"2024-04-25T12:50:54.478971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479694+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:54.479694+0000","last_peered":"2024-04-25T12:50:54.479694+0000","last_clean":"2024-04-25T12:50:54.479694+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:54.479694+0000","last_undegraded":"2024-04-25T12:50:54.479694+0000","last_fullsized":"2024-04-25T12:50:54.479694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599802+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:54.599802+0000","last_peered":"2024-04-25T12:50:54.599802+0000","last_clean":"2024-04-25T12:50:54.599802+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:54.599802+0000","last_undegraded":"2024-04-25T12:50:54.599802+0000","last_fullsized":"2024-04-25T12:50:54.599802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475248+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:54.475248+0000","last_peered":"2024-04-25T12:50:54.475248+0000","last_clean":"2024-04-25T12:50:54.475248+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:54.475248+0000","last_undegraded":"2024-04-25T12:50:54.475248+0000","last_fullsized":"2024-04-25T12:50:54.475248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4098,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599973+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:54.599973+0000","last_peered":"2024-04-25T12:50:54.599973+0000","last_clean":"2024-04-25T12:50:54.599973+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:54.599973+0000","last_undegraded":"2024-04-25T12:50:54.599973+0000","last_fullsized":"2024-04-25T12:50:54.599973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477988+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:54.477988+0000","last_peered":"2024-04-25T12:50:54.477988+0000","last_clean":"2024-04-25T12:50:54.477988+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:54.477988+0000","last_undegraded":"2024-04-25T12:50:54.477988+0000","last_fullsized":"2024-04-25T12:50:54.477988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599804+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:54.599804+0000","last_peered":"2024-04-25T12:50:54.599804+0000","last_clean":"2024-04-25T12:50:54.599804+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:54.599804+0000","last_undegraded":"2024-04-25T12:50:54.599804+0000","last_fullsized":"2024-04-25T12:50:54.599804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477578+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:54.477578+0000","last_peered":"2024-04-25T12:50:54.477578+0000","last_clean":"2024-04-25T12:50:54.477578+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:54.477578+0000","last_undegraded":"2024-04-25T12:50:54.477578+0000","last_fullsized":"2024-04-25T12:50:54.477578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479101+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:54.479101+0000","last_peered":"2024-04-25T12:50:54.479101+0000","last_clean":"2024-04-25T12:50:54.479101+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:54.479101+0000","last_undegraded":"2024-04-25T12:50:54.479101+0000","last_fullsized":"2024-04-25T12:50:54.479101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480204+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:54.480204+0000","last_peered":"2024-04-25T12:50:54.480204+0000","last_clean":"2024-04-25T12:50:54.480204+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:54.480204+0000","last_undegraded":"2024-04-25T12:50:54.480204+0000","last_fullsized":"2024-04-25T12:50:54.480204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599114+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:54.599114+0000","last_peered":"2024-04-25T12:50:54.599114+0000","last_clean":"2024-04-25T12:50:54.599114+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:54.599114+0000","last_undegraded":"2024-04-25T12:50:54.599114+0000","last_fullsized":"2024-04-25T12:50:54.599114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480208+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:54.480208+0000","last_peered":"2024-04-25T12:50:54.480208+0000","last_clean":"2024-04-25T12:50:54.480208+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:54.480208+0000","last_undegraded":"2024-04-25T12:50:54.480208+0000","last_fullsized":"2024-04-25T12:50:54.480208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599573+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:54.599573+0000","last_peered":"2024-04-25T12:50:54.599573+0000","last_clean":"2024-04-25T12:50:54.599573+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:54.599573+0000","last_undegraded":"2024-04-25T12:50:54.599573+0000","last_fullsized":"2024-04-25T12:50:54.599573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478848+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:54.478848+0000","last_peered":"2024-04-25T12:50:54.478848+0000","last_clean":"2024-04-25T12:50:54.478848+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:54.478848+0000","last_undegraded":"2024-04-25T12:50:54.478848+0000","last_fullsized":"2024-04-25T12:50:54.478848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599456+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:54.599456+0000","last_peered":"2024-04-25T12:50:54.599456+0000","last_clean":"2024-04-25T12:50:54.599456+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:54.599456+0000","last_undegraded":"2024-04-25T12:50:54.599456+0000","last_fullsized":"2024-04-25T12:50:54.599456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479149+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:54.479149+0000","last_peered":"2024-04-25T12:50:54.479149+0000","last_clean":"2024-04-25T12:50:54.479149+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:54.479149+0000","last_undegraded":"2024-04-25T12:50:54.479149+0000","last_fullsized":"2024-04-25T12:50:54.479149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474875+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:54.474875+0000","last_peered":"2024-04-25T12:50:54.474875+0000","last_clean":"2024-04-25T12:50:54.474875+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:54.474875+0000","last_undegraded":"2024-04-25T12:50:54.474875+0000","last_fullsized":"2024-04-25T12:50:54.474875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599136+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:54.599136+0000","last_peered":"2024-04-25T12:50:54.599136+0000","last_clean":"2024-04-25T12:50:54.599136+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:54.599136+0000","last_undegraded":"2024-04-25T12:50:54.599136+0000","last_fullsized":"2024-04-25T12:50:54.599136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599786+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:54.599786+0000","last_peered":"2024-04-25T12:50:54.599786+0000","last_clean":"2024-04-25T12:50:54.599786+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:54.599786+0000","last_undegraded":"2024-04-25T12:50:54.599786+0000","last_fullsized":"2024-04-25T12:50:54.599786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474954+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:54.474954+0000","last_peered":"2024-04-25T12:50:54.474954+0000","last_clean":"2024-04-25T12:50:54.474954+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:54.474954+0000","last_undegraded":"2024-04-25T12:50:54.474954+0000","last_fullsized":"2024-04-25T12:50:54.474954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478999+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:54.478999+0000","last_peered":"2024-04-25T12:50:54.478999+0000","last_clean":"2024-04-25T12:50:54.478999+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:54.478999+0000","last_undegraded":"2024-04-25T12:50:54.478999+0000","last_fullsized":"2024-04-25T12:50:54.478999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476107+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:54.476107+0000","last_peered":"2024-04-25T12:50:54.476107+0000","last_clean":"2024-04-25T12:50:54.476107+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:54.476107+0000","last_undegraded":"2024-04-25T12:50:54.476107+0000","last_fullsized":"2024-04-25T12:50:54.476107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599639+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:54.599639+0000","last_peered":"2024-04-25T12:50:54.599639+0000","last_clean":"2024-04-25T12:50:54.599639+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:54.599639+0000","last_undegraded":"2024-04-25T12:50:54.599639+0000","last_fullsized":"2024-04-25T12:50:54.599639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478180+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:54.478180+0000","last_peered":"2024-04-25T12:50:54.478180+0000","last_clean":"2024-04-25T12:50:54.478180+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:54.478180+0000","last_undegraded":"2024-04-25T12:50:54.478180+0000","last_fullsized":"2024-04-25T12:50:54.478180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600139+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:54.600139+0000","last_peered":"2024-04-25T12:50:54.600139+0000","last_clean":"2024-04-25T12:50:54.600139+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:54.600139+0000","last_undegraded":"2024-04-25T12:50:54.600139+0000","last_fullsized":"2024-04-25T12:50:54.600139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474510+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:54.474510+0000","last_peered":"2024-04-25T12:50:54.474510+0000","last_clean":"2024-04-25T12:50:54.474510+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:54.474510+0000","last_undegraded":"2024-04-25T12:50:54.474510+0000","last_fullsized":"2024-04-25T12:50:54.474510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475994+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:54.475994+0000","last_peered":"2024-04-25T12:50:54.475994+0000","last_clean":"2024-04-25T12:50:54.475994+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:54.475994+0000","last_undegraded":"2024-04-25T12:50:54.475994+0000","last_fullsized":"2024-04-25T12:50:54.475994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.603199+0000","last_change":"2024-04-25T12:50:54.603199+0000","last_active":"2024-04-25T12:50:54.603199+0000","last_peered":"2024-04-25T12:50:54.603199+0000","last_clean":"2024-04-25T12:50:54.603199+0000","last_became_active":"2024-04-25T12:50:54.602588+0000","last_became_peered":"2024-04-25T12:50:54.602588+0000","last_unstale":"2024-04-25T12:50:54.603199+0000","last_undegraded":"2024-04-25T12:50:54.603199+0000","last_fullsized":"2024-04-25T12:50:54.603199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:24.120485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478768+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:54.478768+0000","last_peered":"2024-04-25T12:50:54.478768+0000","last_clean":"2024-04-25T12:50:54.478768+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:54.478768+0000","last_undegraded":"2024-04-25T12:50:54.478768+0000","last_fullsized":"2024-04-25T12:50:54.478768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599589+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:54.599589+0000","last_peered":"2024-04-25T12:50:54.599589+0000","last_clean":"2024-04-25T12:50:54.599589+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:54.599589+0000","last_undegraded":"2024-04-25T12:50:54.599589+0000","last_fullsized":"2024-04-25T12:50:54.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599658+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:54.599658+0000","last_peered":"2024-04-25T12:50:54.599658+0000","last_clean":"2024-04-25T12:50:54.599658+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:54.599658+0000","last_undegraded":"2024-04-25T12:50:54.599658+0000","last_fullsized":"2024-04-25T12:50:54.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475338+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:54.475338+0000","last_peered":"2024-04-25T12:50:54.475338+0000","last_clean":"2024-04-25T12:50:54.475338+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:54.475338+0000","last_undegraded":"2024-04-25T12:50:54.475338+0000","last_fullsized":"2024-04-25T12:50:54.475338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600579+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:54.600579+0000","last_peered":"2024-04-25T12:50:54.600579+0000","last_clean":"2024-04-25T12:50:54.600579+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:54.600579+0000","last_undegraded":"2024-04-25T12:50:54.600579+0000","last_fullsized":"2024-04-25T12:50:54.600579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479039+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:54.479039+0000","last_peered":"2024-04-25T12:50:54.479039+0000","last_clean":"2024-04-25T12:50:54.479039+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:54.479039+0000","last_undegraded":"2024-04-25T12:50:54.479039+0000","last_fullsized":"2024-04-25T12:50:54.479039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599703+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:54.599703+0000","last_peered":"2024-04-25T12:50:54.599703+0000","last_clean":"2024-04-25T12:50:54.599703+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:54.599703+0000","last_undegraded":"2024-04-25T12:50:54.599703+0000","last_fullsized":"2024-04-25T12:50:54.599703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.604906+0000","last_change":"2024-04-25T12:50:54.600889+0000","last_active":"2024-04-25T12:50:54.604906+0000","last_peered":"2024-04-25T12:50:54.604906+0000","last_clean":"2024-04-25T12:50:54.604906+0000","last_became_active":"2024-04-25T12:50:54.600590+0000","last_became_peered":"2024-04-25T12:50:54.600590+0000","last_unstale":"2024-04-25T12:50:54.604906+0000","last_undegraded":"2024-04-25T12:50:54.604906+0000","last_fullsized":"2024-04-25T12:50:54.604906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:35.493159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478655+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:54.478655+0000","last_peered":"2024-04-25T12:50:54.478655+0000","last_clean":"2024-04-25T12:50:54.478655+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:54.478655+0000","last_undegraded":"2024-04-25T12:50:54.478655+0000","last_fullsized":"2024-04-25T12:50:54.478655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475148+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:54.475148+0000","last_peered":"2024-04-25T12:50:54.475148+0000","last_clean":"2024-04-25T12:50:54.475148+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:54.475148+0000","last_undegraded":"2024-04-25T12:50:54.475148+0000","last_fullsized":"2024-04-25T12:50:54.475148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600079+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:54.600079+0000","last_peered":"2024-04-25T12:50:54.600079+0000","last_clean":"2024-04-25T12:50:54.600079+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:54.600079+0000","last_undegraded":"2024-04-25T12:50:54.600079+0000","last_fullsized":"2024-04-25T12:50:54.600079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480451+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:54.480451+0000","last_peered":"2024-04-25T12:50:54.480451+0000","last_clean":"2024-04-25T12:50:54.480451+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:54.480451+0000","last_undegraded":"2024-04-25T12:50:54.480451+0000","last_fullsized":"2024-04-25T12:50:54.480451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.485570+0000","last_change":"2024-04-25T12:50:54.481281+0000","last_active":"2024-04-25T12:50:54.485570+0000","last_peered":"2024-04-25T12:50:54.485570+0000","last_clean":"2024-04-25T12:50:54.485570+0000","last_became_active":"2024-04-25T12:50:54.481059+0000","last_became_peered":"2024-04-25T12:50:54.481059+0000","last_unstale":"2024-04-25T12:50:54.485570+0000","last_undegraded":"2024-04-25T12:50:54.485570+0000","last_fullsized":"2024-04-25T12:50:54.485570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:19.251292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478592+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:54.478592+0000","last_peered":"2024-04-25T12:50:54.478592+0000","last_clean":"2024-04-25T12:50:54.478592+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:54.478592+0000","last_undegraded":"2024-04-25T12:50:54.478592+0000","last_fullsized":"2024-04-25T12:50:54.478592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599472+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:54.599472+0000","last_peered":"2024-04-25T12:50:54.599472+0000","last_clean":"2024-04-25T12:50:54.599472+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:54.599472+0000","last_undegraded":"2024-04-25T12:50:54.599472+0000","last_fullsized":"2024-04-25T12:50:54.599472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477863+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:54.477863+0000","last_peered":"2024-04-25T12:50:54.477863+0000","last_clean":"2024-04-25T12:50:54.477863+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:54.477863+0000","last_undegraded":"2024-04-25T12:50:54.477863+0000","last_fullsized":"2024-04-25T12:50:54.477863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475335+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:54.475335+0000","last_peered":"2024-04-25T12:50:54.475335+0000","last_clean":"2024-04-25T12:50:54.475335+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:54.475335+0000","last_undegraded":"2024-04-25T12:50:54.475335+0000","last_fullsized":"2024-04-25T12:50:54.475335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600467+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:54.600467+0000","last_peered":"2024-04-25T12:50:54.600467+0000","last_clean":"2024-04-25T12:50:54.600467+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:54.600467+0000","last_undegraded":"2024-04-25T12:50:54.600467+0000","last_fullsized":"2024-04-25T12:50:54.600467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599016+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:54.599016+0000","last_peered":"2024-04-25T12:50:54.599016+0000","last_clean":"2024-04-25T12:50:54.599016+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:54.599016+0000","last_undegraded":"2024-04-25T12:50:54.599016+0000","last_fullsized":"2024-04-25T12:50:54.599016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599533+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:54.599533+0000","last_peered":"2024-04-25T12:50:54.599533+0000","last_clean":"2024-04-25T12:50:54.599533+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:54.599533+0000","last_undegraded":"2024-04-25T12:50:54.599533+0000","last_fullsized":"2024-04-25T12:50:54.599533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479446+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:54.479446+0000","last_peered":"2024-04-25T12:50:54.479446+0000","last_clean":"2024-04-25T12:50:54.479446+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:54.479446+0000","last_undegraded":"2024-04-25T12:50:54.479446+0000","last_fullsized":"2024-04-25T12:50:54.479446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599664+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:54.599664+0000","last_peered":"2024-04-25T12:50:54.599664+0000","last_clean":"2024-04-25T12:50:54.599664+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:54.599664+0000","last_undegraded":"2024-04-25T12:50:54.599664+0000","last_fullsized":"2024-04-25T12:50:54.599664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479221+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:54.479221+0000","last_peered":"2024-04-25T12:50:54.479221+0000","last_clean":"2024-04-25T12:50:54.479221+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:54.479221+0000","last_undegraded":"2024-04-25T12:50:54.479221+0000","last_fullsized":"2024-04-25T12:50:54.479221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478790+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:54.478790+0000","last_peered":"2024-04-25T12:50:54.478790+0000","last_clean":"2024-04-25T12:50:54.478790+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:54.478790+0000","last_undegraded":"2024-04-25T12:50:54.478790+0000","last_fullsized":"2024-04-25T12:50:54.478790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600065+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:54.600065+0000","last_peered":"2024-04-25T12:50:54.600065+0000","last_clean":"2024-04-25T12:50:54.600065+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:54.600065+0000","last_undegraded":"2024-04-25T12:50:54.600065+0000","last_fullsized":"2024-04-25T12:50:54.600065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600380+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:54.600380+0000","last_peered":"2024-04-25T12:50:54.600380+0000","last_clean":"2024-04-25T12:50:54.600380+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:54.600380+0000","last_undegraded":"2024-04-25T12:50:54.600380+0000","last_fullsized":"2024-04-25T12:50:54.600380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":709565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":702513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":122657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":118649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":115661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":111563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:57.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:57.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.413+0000 7fc1693bb640 1 Processor -- start 2024-04-25T12:50:57.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.413+0000 7fc1693bb640 1 -- start start 2024-04-25T12:50:57.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc1693bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc730 0x7fc16406d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc1693bb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16415ed80 con 0x7fc1641557e0 2024-04-25T12:50:57.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc1693bb640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc16415f060 con 0x7fc1640cc140 2024-04-25T12:50:57.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc1693bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc1640cb5a0 con 0x7fc1640cc730 2024-04-25T12:50:57.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc162ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc1641557e0 0x7fc1640cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56260/0 (socket says 172.21.15.132:56260) 2024-04-25T12:50:57.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc162ffd640 1 -- 172.21.15.132:0/1163948256 learned_addr learned my addr 172.21.15.132:0/1163948256 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.414+0000 7fc1637fe640 1 --2- 172.21.15.132:0/1163948256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc730 0x7fc16406d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172314747 0 0) 0x7fc16415ed80 con 0x7fc1641557e0 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc150003520 con 0x7fc1641557e0 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1709849912 0 0) 0x7fc16415f060 con 0x7fc1640cc140 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc16415ed80 con 0x7fc1640cc140 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1637fe640 1 -- 172.21.15.132:0/1163948256 >> v1:172.21.15.157:6789/0 conn(0x7fc1640cc140 legacy=0x7fc16406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1637fe640 1 -- 172.21.15.132:0/1163948256 >> v1:172.21.15.132:6789/0 conn(0x7fc1641557e0 legacy=0x7fc1640cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3629717502 0 0) 0x7fc150003520 con 0x7fc1641557e0 2024-04-25T12:50:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.415+0000 7fc1637fe640 1 -- 172.21.15.132:0/1163948256 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc16415f340 con 0x7fc1640cc730 2024-04-25T12:50:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1637fe640 1 --2- 172.21.15.132:0/1163948256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc730 0x7fc16406d0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009dc0 tx=0x7fc15c02a660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cacb5a38ae1879a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc154001670 con 0x7fc1640cc730 2024-04-25T12:50:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c007540 con 0x7fc1640cc730 2024-04-25T12:50:57.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1627fc640 1 -- 172.21.15.132:0/1163948256 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0078f0 con 0x7fc1640cc730 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 -- 172.21.15.132:0/1163948256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc730 msgr2=0x7fc16406d0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 --2- 172.21.15.132:0/1163948256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc730 0x7fc16406d0d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009dc0 tx=0x7fc15c02a660 comp rx=0 tx=0).stop 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 -- 172.21.15.132:0/1163948256 shutdown_connections 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 --2- 172.21.15.132:0/1163948256 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc730 0x7fc16406d0d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 -- 172.21.15.132:0/1163948256 >> 172.21.15.132:0/1163948256 conn(0x7fc1640d0e10 msgr2=0x7fc1640d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 -- 172.21.15.132:0/1163948256 shutdown_connections 2024-04-25T12:50:57.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.416+0000 7fc1693bb640 1 -- 172.21.15.132:0/1163948256 wait complete. 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.417+0000 7fc1693bb640 1 Processor -- start 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.417+0000 7fc1693bb640 1 -- start start 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1693bb640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc140 0x7fc16415e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1693bb640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1640cc730 0x7fc16415c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1693bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 0x7fc164148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1693bb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc1640cd0c0 con 0x7fc1641557e0 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1693bb640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc16406d610 con 0x7fc1640cc730 2024-04-25T12:50:57.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1693bb640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc1640cd240 con 0x7fc1640cc140 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 0x7fc164148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 0x7fc164148710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54086/0 (socket says 172.21.15.132:54086) 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc1637fe640 1 -- 172.21.15.132:0/3611140803 learned_addr learned my addr 172.21.15.132:0/3611140803 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc15bfff640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1640cc730 0x7fc16415c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.418+0000 7fc162ffd640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc140 0x7fc16415e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1637fe640 1 -- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc140 msgr2=0x7fc16415e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1637fe640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc140 0x7fc16415e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1637fe640 1 -- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1640cc730 msgr2=0x7fc16415c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1637fe640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1640cc730 0x7fc16415c510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1637fe640 1 -- 172.21.15.132:0/3611140803 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1641f1460 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1637fe640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 0x7fc164148710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ee0 tx=0x7fc15c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c009450 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc15c004240 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1641f1720 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc15c0045f0 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.419+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1641578d0 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.420+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc164068c20 con 0x7fc1641557e0 2024-04-25T12:50:57.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.420+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc15c039040 con 0x7fc1641557e0 2024-04-25T12:50:57.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.421+0000 7fc15b7fe640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc14406c8f0 0x7fc14406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.421+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc15c0ad490 con 0x7fc1641557e0 2024-04-25T12:50:57.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.421+0000 7fc162ffd640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc14406c8f0 0x7fc14406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.421+0000 7fc162ffd640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc14406c8f0 0x7fc14406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1540011e0 tx=0x7fc154009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.425+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc15c040030 con 0x7fc1641557e0 2024-04-25T12:50:57.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.597+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc164152fa0 con 0x7fc14406c8f0 2024-04-25T12:50:57.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.604+0000 7fc15b7fe640 1 -- 172.21.15.132:0/3611140803 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7fc164152fa0 con 0x7fc14406c8f0 2024-04-25T12:50:57.607 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:57.609 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc14406c8f0 msgr2=0x7fc14406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc14406c8f0 0x7fc14406edb0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc1540011e0 tx=0x7fc154009040 comp rx=0 tx=0).stop 2024-04-25T12:50:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 msgr2=0x7fc164148710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 0x7fc164148710 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc15c009ee0 tx=0x7fc15c004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 shutdown_connections 2024-04-25T12:50:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc14406c8f0 0x7fc14406edb0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1641557e0 0x7fc164148710 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc1640cc730 0x7fc16415c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 --2- 172.21.15.132:0/3611140803 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc1640cc140 0x7fc16415e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 >> 172.21.15.132:0/3611140803 conn(0x7fc1640d0e10 msgr2=0x7fc1640c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 shutdown_connections 2024-04-25T12:50:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.608+0000 7fc1693bb640 1 -- 172.21.15.132:0/3611140803 wait complete. 2024-04-25T12:50:57.618 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-25T12:50:57.136905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595264,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":325,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232084,"kb_used_data":3428,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742636,"statfs":{"total":773094113280,"available":772856459264,"internally_reserved":0,"allocated":3510272,"data_stored":2118012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001430"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479195+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:54.479195+0000","last_peered":"2024-04-25T12:50:54.479195+0000","last_clean":"2024-04-25T12:50:54.479195+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:54.479195+0000","last_undegraded":"2024-04-25T12:50:54.479195+0000","last_fullsized":"2024-04-25T12:50:54.479195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600202+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:54.600202+0000","last_peered":"2024-04-25T12:50:54.600202+0000","last_clean":"2024-04-25T12:50:54.600202+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:54.600202+0000","last_undegraded":"2024-04-25T12:50:54.600202+0000","last_fullsized":"2024-04-25T12:50:54.600202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599272+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:54.599272+0000","last_peered":"2024-04-25T12:50:54.599272+0000","last_clean":"2024-04-25T12:50:54.599272+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:54.599272+0000","last_undegraded":"2024-04-25T12:50:54.599272+0000","last_fullsized":"2024-04-25T12:50:54.599272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600386+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:54.600386+0000","last_peered":"2024-04-25T12:50:54.600386+0000","last_clean":"2024-04-25T12:50:54.600386+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:54.600386+0000","last_undegraded":"2024-04-25T12:50:54.600386+0000","last_fullsized":"2024-04-25T12:50:54.600386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602722+0000","last_change":"2024-04-25T12:50:54.602722+0000","last_active":"2024-04-25T12:50:54.602722+0000","last_peered":"2024-04-25T12:50:54.602722+0000","last_clean":"2024-04-25T12:50:54.602722+0000","last_became_active":"2024-04-25T12:50:54.602420+0000","last_became_peered":"2024-04-25T12:50:54.602420+0000","last_unstale":"2024-04-25T12:50:54.602722+0000","last_undegraded":"2024-04-25T12:50:54.602722+0000","last_fullsized":"2024-04-25T12:50:54.602722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:56.779821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477099+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:54.477099+0000","last_peered":"2024-04-25T12:50:54.477099+0000","last_clean":"2024-04-25T12:50:54.477099+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:54.477099+0000","last_undegraded":"2024-04-25T12:50:54.477099+0000","last_fullsized":"2024-04-25T12:50:54.477099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600037+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:54.600037+0000","last_peered":"2024-04-25T12:50:54.600037+0000","last_clean":"2024-04-25T12:50:54.600037+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:54.600037+0000","last_undegraded":"2024-04-25T12:50:54.600037+0000","last_fullsized":"2024-04-25T12:50:54.600037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479322+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:54.479322+0000","last_peered":"2024-04-25T12:50:54.479322+0000","last_clean":"2024-04-25T12:50:54.479322+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:54.479322+0000","last_undegraded":"2024-04-25T12:50:54.479322+0000","last_fullsized":"2024-04-25T12:50:54.479322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477511+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:54.477511+0000","last_peered":"2024-04-25T12:50:54.477511+0000","last_clean":"2024-04-25T12:50:54.477511+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:54.477511+0000","last_undegraded":"2024-04-25T12:50:54.477511+0000","last_fullsized":"2024-04-25T12:50:54.477511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599777+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:54.599777+0000","last_peered":"2024-04-25T12:50:54.599777+0000","last_clean":"2024-04-25T12:50:54.599777+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:54.599777+0000","last_undegraded":"2024-04-25T12:50:54.599777+0000","last_fullsized":"2024-04-25T12:50:54.599777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479735+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:54.479735+0000","last_peered":"2024-04-25T12:50:54.479735+0000","last_clean":"2024-04-25T12:50:54.479735+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:54.479735+0000","last_undegraded":"2024-04-25T12:50:54.479735+0000","last_fullsized":"2024-04-25T12:50:54.479735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477367+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:54.477367+0000","last_peered":"2024-04-25T12:50:54.477367+0000","last_clean":"2024-04-25T12:50:54.477367+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:54.477367+0000","last_undegraded":"2024-04-25T12:50:54.477367+0000","last_fullsized":"2024-04-25T12:50:54.477367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474699+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:54.474699+0000","last_peered":"2024-04-25T12:50:54.474699+0000","last_clean":"2024-04-25T12:50:54.474699+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:54.474699+0000","last_undegraded":"2024-04-25T12:50:54.474699+0000","last_fullsized":"2024-04-25T12:50:54.474699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599849+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:54.599849+0000","last_peered":"2024-04-25T12:50:54.599849+0000","last_clean":"2024-04-25T12:50:54.599849+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:54.599849+0000","last_undegraded":"2024-04-25T12:50:54.599849+0000","last_fullsized":"2024-04-25T12:50:54.599849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477799+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:54.477799+0000","last_peered":"2024-04-25T12:50:54.477799+0000","last_clean":"2024-04-25T12:50:54.477799+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:54.477799+0000","last_undegraded":"2024-04-25T12:50:54.477799+0000","last_fullsized":"2024-04-25T12:50:54.477799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600162+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:54.600162+0000","last_peered":"2024-04-25T12:50:54.600162+0000","last_clean":"2024-04-25T12:50:54.600162+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:54.600162+0000","last_undegraded":"2024-04-25T12:50:54.600162+0000","last_fullsized":"2024-04-25T12:50:54.600162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601620+0000","last_change":"2024-04-25T12:50:54.601620+0000","last_active":"2024-04-25T12:50:54.601620+0000","last_peered":"2024-04-25T12:50:54.601620+0000","last_clean":"2024-04-25T12:50:54.601620+0000","last_became_active":"2024-04-25T12:50:54.601163+0000","last_became_peered":"2024-04-25T12:50:54.601163+0000","last_unstale":"2024-04-25T12:50:54.601620+0000","last_undegraded":"2024-04-25T12:50:54.601620+0000","last_fullsized":"2024-04-25T12:50:54.601620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:02.679362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599233+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:54.599233+0000","last_peered":"2024-04-25T12:50:54.599233+0000","last_clean":"2024-04-25T12:50:54.599233+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:54.599233+0000","last_undegraded":"2024-04-25T12:50:54.599233+0000","last_fullsized":"2024-04-25T12:50:54.599233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600288+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:54.600288+0000","last_peered":"2024-04-25T12:50:54.600288+0000","last_clean":"2024-04-25T12:50:54.600288+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:54.600288+0000","last_undegraded":"2024-04-25T12:50:54.600288+0000","last_fullsized":"2024-04-25T12:50:54.600288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600400+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:54.600400+0000","last_peered":"2024-04-25T12:50:54.600400+0000","last_clean":"2024-04-25T12:50:54.600400+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:54.600400+0000","last_undegraded":"2024-04-25T12:50:54.600400+0000","last_fullsized":"2024-04-25T12:50:54.600400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478229+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:54.478229+0000","last_peered":"2024-04-25T12:50:54.478229+0000","last_clean":"2024-04-25T12:50:54.478229+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:54.478229+0000","last_undegraded":"2024-04-25T12:50:54.478229+0000","last_fullsized":"2024-04-25T12:50:54.478229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599368+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:54.599368+0000","last_peered":"2024-04-25T12:50:54.599368+0000","last_clean":"2024-04-25T12:50:54.599368+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:54.599368+0000","last_undegraded":"2024-04-25T12:50:54.599368+0000","last_fullsized":"2024-04-25T12:50:54.599368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478354+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:54.478354+0000","last_peered":"2024-04-25T12:50:54.478354+0000","last_clean":"2024-04-25T12:50:54.478354+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:54.478354+0000","last_undegraded":"2024-04-25T12:50:54.478354+0000","last_fullsized":"2024-04-25T12:50:54.478354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478968+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:54.478968+0000","last_peered":"2024-04-25T12:50:54.478968+0000","last_clean":"2024-04-25T12:50:54.478968+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:54.478968+0000","last_undegraded":"2024-04-25T12:50:54.478968+0000","last_fullsized":"2024-04-25T12:50:54.478968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475142+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:54.475142+0000","last_peered":"2024-04-25T12:50:54.475142+0000","last_clean":"2024-04-25T12:50:54.475142+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:54.475142+0000","last_undegraded":"2024-04-25T12:50:54.475142+0000","last_fullsized":"2024-04-25T12:50:54.475142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478073+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:54.478073+0000","last_peered":"2024-04-25T12:50:54.478073+0000","last_clean":"2024-04-25T12:50:54.478073+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:54.478073+0000","last_undegraded":"2024-04-25T12:50:54.478073+0000","last_fullsized":"2024-04-25T12:50:54.478073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600661+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:54.600661+0000","last_peered":"2024-04-25T12:50:54.600661+0000","last_clean":"2024-04-25T12:50:54.600661+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:54.600661+0000","last_undegraded":"2024-04-25T12:50:54.600661+0000","last_fullsized":"2024-04-25T12:50:54.600661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600151+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:54.600151+0000","last_peered":"2024-04-25T12:50:54.600151+0000","last_clean":"2024-04-25T12:50:54.600151+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:54.600151+0000","last_undegraded":"2024-04-25T12:50:54.600151+0000","last_fullsized":"2024-04-25T12:50:54.600151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.598907+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:54.598907+0000","last_peered":"2024-04-25T12:50:54.598907+0000","last_clean":"2024-04-25T12:50:54.598907+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:54.598907+0000","last_undegraded":"2024-04-25T12:50:54.598907+0000","last_fullsized":"2024-04-25T12:50:54.598907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600154+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:54.600154+0000","last_peered":"2024-04-25T12:50:54.600154+0000","last_clean":"2024-04-25T12:50:54.600154+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:54.600154+0000","last_undegraded":"2024-04-25T12:50:54.600154+0000","last_fullsized":"2024-04-25T12:50:54.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600170+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:54.600170+0000","last_peered":"2024-04-25T12:50:54.600170+0000","last_clean":"2024-04-25T12:50:54.600170+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:54.600170+0000","last_undegraded":"2024-04-25T12:50:54.600170+0000","last_fullsized":"2024-04-25T12:50:54.600170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478601+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:54.478601+0000","last_peered":"2024-04-25T12:50:54.478601+0000","last_clean":"2024-04-25T12:50:54.478601+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:54.478601+0000","last_undegraded":"2024-04-25T12:50:54.478601+0000","last_fullsized":"2024-04-25T12:50:54.478601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480012+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:54.480012+0000","last_peered":"2024-04-25T12:50:54.480012+0000","last_clean":"2024-04-25T12:50:54.480012+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:54.480012+0000","last_undegraded":"2024-04-25T12:50:54.480012+0000","last_fullsized":"2024-04-25T12:50:54.480012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600254+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:54.600254+0000","last_peered":"2024-04-25T12:50:54.600254+0000","last_clean":"2024-04-25T12:50:54.600254+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:54.600254+0000","last_undegraded":"2024-04-25T12:50:54.600254+0000","last_fullsized":"2024-04-25T12:50:54.600254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599823+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:54.599823+0000","last_peered":"2024-04-25T12:50:54.599823+0000","last_clean":"2024-04-25T12:50:54.599823+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:54.599823+0000","last_undegraded":"2024-04-25T12:50:54.599823+0000","last_fullsized":"2024-04-25T12:50:54.599823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477890+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:54.477890+0000","last_peered":"2024-04-25T12:50:54.477890+0000","last_clean":"2024-04-25T12:50:54.477890+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:54.477890+0000","last_undegraded":"2024-04-25T12:50:54.477890+0000","last_fullsized":"2024-04-25T12:50:54.477890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479691+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:54.479691+0000","last_peered":"2024-04-25T12:50:54.479691+0000","last_clean":"2024-04-25T12:50:54.479691+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:54.479691+0000","last_undegraded":"2024-04-25T12:50:54.479691+0000","last_fullsized":"2024-04-25T12:50:54.479691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599847+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:54.599847+0000","last_peered":"2024-04-25T12:50:54.599847+0000","last_clean":"2024-04-25T12:50:54.599847+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:54.599847+0000","last_undegraded":"2024-04-25T12:50:54.599847+0000","last_fullsized":"2024-04-25T12:50:54.599847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599531+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:54.599531+0000","last_peered":"2024-04-25T12:50:54.599531+0000","last_clean":"2024-04-25T12:50:54.599531+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:54.599531+0000","last_undegraded":"2024-04-25T12:50:54.599531+0000","last_fullsized":"2024-04-25T12:50:54.599531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476542+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:54.476542+0000","last_peered":"2024-04-25T12:50:54.476542+0000","last_clean":"2024-04-25T12:50:54.476542+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:54.476542+0000","last_undegraded":"2024-04-25T12:50:54.476542+0000","last_fullsized":"2024-04-25T12:50:54.476542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600495+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:54.600495+0000","last_peered":"2024-04-25T12:50:54.600495+0000","last_clean":"2024-04-25T12:50:54.600495+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:54.600495+0000","last_undegraded":"2024-04-25T12:50:54.600495+0000","last_fullsized":"2024-04-25T12:50:54.600495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478363+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:54.478363+0000","last_peered":"2024-04-25T12:50:54.478363+0000","last_clean":"2024-04-25T12:50:54.478363+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:54.478363+0000","last_undegraded":"2024-04-25T12:50:54.478363+0000","last_fullsized":"2024-04-25T12:50:54.478363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599446+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:54.599446+0000","last_peered":"2024-04-25T12:50:54.599446+0000","last_clean":"2024-04-25T12:50:54.599446+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:54.599446+0000","last_undegraded":"2024-04-25T12:50:54.599446+0000","last_fullsized":"2024-04-25T12:50:54.599446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601447+0000","last_change":"2024-04-25T12:50:54.601447+0000","last_active":"2024-04-25T12:50:54.601447+0000","last_peered":"2024-04-25T12:50:54.601447+0000","last_clean":"2024-04-25T12:50:54.601447+0000","last_became_active":"2024-04-25T12:50:54.601056+0000","last_became_peered":"2024-04-25T12:50:54.601056+0000","last_unstale":"2024-04-25T12:50:54.601447+0000","last_undegraded":"2024-04-25T12:50:54.601447+0000","last_fullsized":"2024-04-25T12:50:54.601447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:00.221828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599271+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:54.599271+0000","last_peered":"2024-04-25T12:50:54.599271+0000","last_clean":"2024-04-25T12:50:54.599271+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:54.599271+0000","last_undegraded":"2024-04-25T12:50:54.599271+0000","last_fullsized":"2024-04-25T12:50:54.599271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479375+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:54.479375+0000","last_peered":"2024-04-25T12:50:54.479375+0000","last_clean":"2024-04-25T12:50:54.479375+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:54.479375+0000","last_undegraded":"2024-04-25T12:50:54.479375+0000","last_fullsized":"2024-04-25T12:50:54.479375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599510+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:54.599510+0000","last_peered":"2024-04-25T12:50:54.599510+0000","last_clean":"2024-04-25T12:50:54.599510+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:54.599510+0000","last_undegraded":"2024-04-25T12:50:54.599510+0000","last_fullsized":"2024-04-25T12:50:54.599510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474978+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:54.474978+0000","last_peered":"2024-04-25T12:50:54.474978+0000","last_clean":"2024-04-25T12:50:54.474978+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:54.474978+0000","last_undegraded":"2024-04-25T12:50:54.474978+0000","last_fullsized":"2024-04-25T12:50:54.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599883+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:54.599883+0000","last_peered":"2024-04-25T12:50:54.599883+0000","last_clean":"2024-04-25T12:50:54.599883+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:54.599883+0000","last_undegraded":"2024-04-25T12:50:54.599883+0000","last_fullsized":"2024-04-25T12:50:54.599883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474733+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:54.474733+0000","last_peered":"2024-04-25T12:50:54.474733+0000","last_clean":"2024-04-25T12:50:54.474733+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:54.474733+0000","last_undegraded":"2024-04-25T12:50:54.474733+0000","last_fullsized":"2024-04-25T12:50:54.474733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479406+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:54.479406+0000","last_peered":"2024-04-25T12:50:54.479406+0000","last_clean":"2024-04-25T12:50:54.479406+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:54.479406+0000","last_undegraded":"2024-04-25T12:50:54.479406+0000","last_fullsized":"2024-04-25T12:50:54.479406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599921+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:54.599921+0000","last_peered":"2024-04-25T12:50:54.599921+0000","last_clean":"2024-04-25T12:50:54.599921+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:54.599921+0000","last_undegraded":"2024-04-25T12:50:54.599921+0000","last_fullsized":"2024-04-25T12:50:54.599921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478719+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:54.478719+0000","last_peered":"2024-04-25T12:50:54.478719+0000","last_clean":"2024-04-25T12:50:54.478719+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:54.478719+0000","last_undegraded":"2024-04-25T12:50:54.478719+0000","last_fullsized":"2024-04-25T12:50:54.478719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600500+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:54.600500+0000","last_peered":"2024-04-25T12:50:54.600500+0000","last_clean":"2024-04-25T12:50:54.600500+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:54.600500+0000","last_undegraded":"2024-04-25T12:50:54.600500+0000","last_fullsized":"2024-04-25T12:50:54.600500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476341+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:54.476341+0000","last_peered":"2024-04-25T12:50:54.476341+0000","last_clean":"2024-04-25T12:50:54.476341+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:54.476341+0000","last_undegraded":"2024-04-25T12:50:54.476341+0000","last_fullsized":"2024-04-25T12:50:54.476341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478904+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:54.478904+0000","last_peered":"2024-04-25T12:50:54.478904+0000","last_clean":"2024-04-25T12:50:54.478904+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:54.478904+0000","last_undegraded":"2024-04-25T12:50:54.478904+0000","last_fullsized":"2024-04-25T12:50:54.478904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600300+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:54.600300+0000","last_peered":"2024-04-25T12:50:54.600300+0000","last_clean":"2024-04-25T12:50:54.600300+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:54.600300+0000","last_undegraded":"2024-04-25T12:50:54.600300+0000","last_fullsized":"2024-04-25T12:50:54.600300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478701+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:54.478701+0000","last_peered":"2024-04-25T12:50:54.478701+0000","last_clean":"2024-04-25T12:50:54.478701+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:54.478701+0000","last_undegraded":"2024-04-25T12:50:54.478701+0000","last_fullsized":"2024-04-25T12:50:54.478701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602094+0000","last_change":"2024-04-25T12:50:54.602094+0000","last_active":"2024-04-25T12:50:54.602094+0000","last_peered":"2024-04-25T12:50:54.602094+0000","last_clean":"2024-04-25T12:50:54.602094+0000","last_became_active":"2024-04-25T12:50:54.601336+0000","last_became_peered":"2024-04-25T12:50:54.601336+0000","last_unstale":"2024-04-25T12:50:54.602094+0000","last_undegraded":"2024-04-25T12:50:54.602094+0000","last_fullsized":"2024-04-25T12:50:54.602094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:50.002160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.483087+0000","last_change":"2024-04-25T12:50:54.479164+0000","last_active":"2024-04-25T12:50:54.483087+0000","last_peered":"2024-04-25T12:50:54.483087+0000","last_clean":"2024-04-25T12:50:54.483087+0000","last_became_active":"2024-04-25T12:50:54.478889+0000","last_became_peered":"2024-04-25T12:50:54.478889+0000","last_unstale":"2024-04-25T12:50:54.483087+0000","last_undegraded":"2024-04-25T12:50:54.483087+0000","last_fullsized":"2024-04-25T12:50:54.483087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:51.351035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475987+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:54.475987+0000","last_peered":"2024-04-25T12:50:54.475987+0000","last_clean":"2024-04-25T12:50:54.475987+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:54.475987+0000","last_undegraded":"2024-04-25T12:50:54.475987+0000","last_fullsized":"2024-04-25T12:50:54.475987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478799+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:54.478799+0000","last_peered":"2024-04-25T12:50:54.478799+0000","last_clean":"2024-04-25T12:50:54.478799+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:54.478799+0000","last_undegraded":"2024-04-25T12:50:54.478799+0000","last_fullsized":"2024-04-25T12:50:54.478799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474617+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:54.474617+0000","last_peered":"2024-04-25T12:50:54.474617+0000","last_clean":"2024-04-25T12:50:54.474617+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:54.474617+0000","last_undegraded":"2024-04-25T12:50:54.474617+0000","last_fullsized":"2024-04-25T12:50:54.474617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474706+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:54.474706+0000","last_peered":"2024-04-25T12:50:54.474706+0000","last_clean":"2024-04-25T12:50:54.474706+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:54.474706+0000","last_undegraded":"2024-04-25T12:50:54.474706+0000","last_fullsized":"2024-04-25T12:50:54.474706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600491+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:54.600491+0000","last_peered":"2024-04-25T12:50:54.600491+0000","last_clean":"2024-04-25T12:50:54.600491+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:54.600491+0000","last_undegraded":"2024-04-25T12:50:54.600491+0000","last_fullsized":"2024-04-25T12:50:54.600491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599852+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:54.599852+0000","last_peered":"2024-04-25T12:50:54.599852+0000","last_clean":"2024-04-25T12:50:54.599852+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:54.599852+0000","last_undegraded":"2024-04-25T12:50:54.599852+0000","last_fullsized":"2024-04-25T12:50:54.599852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479586+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:54.479586+0000","last_peered":"2024-04-25T12:50:54.479586+0000","last_clean":"2024-04-25T12:50:54.479586+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:54.479586+0000","last_undegraded":"2024-04-25T12:50:54.479586+0000","last_fullsized":"2024-04-25T12:50:54.479586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599324+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:54.599324+0000","last_peered":"2024-04-25T12:50:54.599324+0000","last_clean":"2024-04-25T12:50:54.599324+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:54.599324+0000","last_undegraded":"2024-04-25T12:50:54.599324+0000","last_fullsized":"2024-04-25T12:50:54.599324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478503+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:54.478503+0000","last_peered":"2024-04-25T12:50:54.478503+0000","last_clean":"2024-04-25T12:50:54.478503+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:54.478503+0000","last_undegraded":"2024-04-25T12:50:54.478503+0000","last_fullsized":"2024-04-25T12:50:54.478503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478971+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:54.478971+0000","last_peered":"2024-04-25T12:50:54.478971+0000","last_clean":"2024-04-25T12:50:54.478971+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:54.478971+0000","last_undegraded":"2024-04-25T12:50:54.478971+0000","last_fullsized":"2024-04-25T12:50:54.478971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479694+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:54.479694+0000","last_peered":"2024-04-25T12:50:54.479694+0000","last_clean":"2024-04-25T12:50:54.479694+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:54.479694+0000","last_undegraded":"2024-04-25T12:50:54.479694+0000","last_fullsized":"2024-04-25T12:50:54.479694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599802+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:54.599802+0000","last_peered":"2024-04-25T12:50:54.599802+0000","last_clean":"2024-04-25T12:50:54.599802+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:54.599802+0000","last_undegraded":"2024-04-25T12:50:54.599802+0000","last_fullsized":"2024-04-25T12:50:54.599802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475248+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:54.475248+0000","last_peered":"2024-04-25T12:50:54.475248+0000","last_clean":"2024-04-25T12:50:54.475248+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:54.475248+0000","last_undegraded":"2024-04-25T12:50:54.475248+0000","last_fullsized":"2024-04-25T12:50:54.475248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4098,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599973+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:54.599973+0000","last_peered":"2024-04-25T12:50:54.599973+0000","last_clean":"2024-04-25T12:50:54.599973+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:54.599973+0000","last_undegraded":"2024-04-25T12:50:54.599973+0000","last_fullsized":"2024-04-25T12:50:54.599973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477988+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:54.477988+0000","last_peered":"2024-04-25T12:50:54.477988+0000","last_clean":"2024-04-25T12:50:54.477988+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:54.477988+0000","last_undegraded":"2024-04-25T12:50:54.477988+0000","last_fullsized":"2024-04-25T12:50:54.477988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599804+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:54.599804+0000","last_peered":"2024-04-25T12:50:54.599804+0000","last_clean":"2024-04-25T12:50:54.599804+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:54.599804+0000","last_undegraded":"2024-04-25T12:50:54.599804+0000","last_fullsized":"2024-04-25T12:50:54.599804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477578+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:54.477578+0000","last_peered":"2024-04-25T12:50:54.477578+0000","last_clean":"2024-04-25T12:50:54.477578+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:54.477578+0000","last_undegraded":"2024-04-25T12:50:54.477578+0000","last_fullsized":"2024-04-25T12:50:54.477578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479101+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:54.479101+0000","last_peered":"2024-04-25T12:50:54.479101+0000","last_clean":"2024-04-25T12:50:54.479101+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:54.479101+0000","last_undegraded":"2024-04-25T12:50:54.479101+0000","last_fullsized":"2024-04-25T12:50:54.479101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480204+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:54.480204+0000","last_peered":"2024-04-25T12:50:54.480204+0000","last_clean":"2024-04-25T12:50:54.480204+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:54.480204+0000","last_undegraded":"2024-04-25T12:50:54.480204+0000","last_fullsized":"2024-04-25T12:50:54.480204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599114+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:54.599114+0000","last_peered":"2024-04-25T12:50:54.599114+0000","last_clean":"2024-04-25T12:50:54.599114+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:54.599114+0000","last_undegraded":"2024-04-25T12:50:54.599114+0000","last_fullsized":"2024-04-25T12:50:54.599114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480208+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:54.480208+0000","last_peered":"2024-04-25T12:50:54.480208+0000","last_clean":"2024-04-25T12:50:54.480208+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:54.480208+0000","last_undegraded":"2024-04-25T12:50:54.480208+0000","last_fullsized":"2024-04-25T12:50:54.480208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599573+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:54.599573+0000","last_peered":"2024-04-25T12:50:54.599573+0000","last_clean":"2024-04-25T12:50:54.599573+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:54.599573+0000","last_undegraded":"2024-04-25T12:50:54.599573+0000","last_fullsized":"2024-04-25T12:50:54.599573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478848+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:54.478848+0000","last_peered":"2024-04-25T12:50:54.478848+0000","last_clean":"2024-04-25T12:50:54.478848+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:54.478848+0000","last_undegraded":"2024-04-25T12:50:54.478848+0000","last_fullsized":"2024-04-25T12:50:54.478848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599456+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:54.599456+0000","last_peered":"2024-04-25T12:50:54.599456+0000","last_clean":"2024-04-25T12:50:54.599456+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:54.599456+0000","last_undegraded":"2024-04-25T12:50:54.599456+0000","last_fullsized":"2024-04-25T12:50:54.599456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479149+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:54.479149+0000","last_peered":"2024-04-25T12:50:54.479149+0000","last_clean":"2024-04-25T12:50:54.479149+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:54.479149+0000","last_undegraded":"2024-04-25T12:50:54.479149+0000","last_fullsized":"2024-04-25T12:50:54.479149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474875+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:54.474875+0000","last_peered":"2024-04-25T12:50:54.474875+0000","last_clean":"2024-04-25T12:50:54.474875+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:54.474875+0000","last_undegraded":"2024-04-25T12:50:54.474875+0000","last_fullsized":"2024-04-25T12:50:54.474875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599136+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:54.599136+0000","last_peered":"2024-04-25T12:50:54.599136+0000","last_clean":"2024-04-25T12:50:54.599136+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:54.599136+0000","last_undegraded":"2024-04-25T12:50:54.599136+0000","last_fullsized":"2024-04-25T12:50:54.599136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599786+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:54.599786+0000","last_peered":"2024-04-25T12:50:54.599786+0000","last_clean":"2024-04-25T12:50:54.599786+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:54.599786+0000","last_undegraded":"2024-04-25T12:50:54.599786+0000","last_fullsized":"2024-04-25T12:50:54.599786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474954+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:54.474954+0000","last_peered":"2024-04-25T12:50:54.474954+0000","last_clean":"2024-04-25T12:50:54.474954+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:54.474954+0000","last_undegraded":"2024-04-25T12:50:54.474954+0000","last_fullsized":"2024-04-25T12:50:54.474954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478999+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:54.478999+0000","last_peered":"2024-04-25T12:50:54.478999+0000","last_clean":"2024-04-25T12:50:54.478999+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:54.478999+0000","last_undegraded":"2024-04-25T12:50:54.478999+0000","last_fullsized":"2024-04-25T12:50:54.478999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476107+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:54.476107+0000","last_peered":"2024-04-25T12:50:54.476107+0000","last_clean":"2024-04-25T12:50:54.476107+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:54.476107+0000","last_undegraded":"2024-04-25T12:50:54.476107+0000","last_fullsized":"2024-04-25T12:50:54.476107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599639+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:54.599639+0000","last_peered":"2024-04-25T12:50:54.599639+0000","last_clean":"2024-04-25T12:50:54.599639+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:54.599639+0000","last_undegraded":"2024-04-25T12:50:54.599639+0000","last_fullsized":"2024-04-25T12:50:54.599639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478180+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:54.478180+0000","last_peered":"2024-04-25T12:50:54.478180+0000","last_clean":"2024-04-25T12:50:54.478180+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:54.478180+0000","last_undegraded":"2024-04-25T12:50:54.478180+0000","last_fullsized":"2024-04-25T12:50:54.478180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600139+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:54.600139+0000","last_peered":"2024-04-25T12:50:54.600139+0000","last_clean":"2024-04-25T12:50:54.600139+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:54.600139+0000","last_undegraded":"2024-04-25T12:50:54.600139+0000","last_fullsized":"2024-04-25T12:50:54.600139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474510+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:54.474510+0000","last_peered":"2024-04-25T12:50:54.474510+0000","last_clean":"2024-04-25T12:50:54.474510+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:54.474510+0000","last_undegraded":"2024-04-25T12:50:54.474510+0000","last_fullsized":"2024-04-25T12:50:54.474510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475994+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:54.475994+0000","last_peered":"2024-04-25T12:50:54.475994+0000","last_clean":"2024-04-25T12:50:54.475994+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:54.475994+0000","last_undegraded":"2024-04-25T12:50:54.475994+0000","last_fullsized":"2024-04-25T12:50:54.475994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.603199+0000","last_change":"2024-04-25T12:50:54.603199+0000","last_active":"2024-04-25T12:50:54.603199+0000","last_peered":"2024-04-25T12:50:54.603199+0000","last_clean":"2024-04-25T12:50:54.603199+0000","last_became_active":"2024-04-25T12:50:54.602588+0000","last_became_peered":"2024-04-25T12:50:54.602588+0000","last_unstale":"2024-04-25T12:50:54.603199+0000","last_undegraded":"2024-04-25T12:50:54.603199+0000","last_fullsized":"2024-04-25T12:50:54.603199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:24.120485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478768+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:54.478768+0000","last_peered":"2024-04-25T12:50:54.478768+0000","last_clean":"2024-04-25T12:50:54.478768+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:54.478768+0000","last_undegraded":"2024-04-25T12:50:54.478768+0000","last_fullsized":"2024-04-25T12:50:54.478768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599589+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:54.599589+0000","last_peered":"2024-04-25T12:50:54.599589+0000","last_clean":"2024-04-25T12:50:54.599589+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:54.599589+0000","last_undegraded":"2024-04-25T12:50:54.599589+0000","last_fullsized":"2024-04-25T12:50:54.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599658+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:54.599658+0000","last_peered":"2024-04-25T12:50:54.599658+0000","last_clean":"2024-04-25T12:50:54.599658+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:54.599658+0000","last_undegraded":"2024-04-25T12:50:54.599658+0000","last_fullsized":"2024-04-25T12:50:54.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475338+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:54.475338+0000","last_peered":"2024-04-25T12:50:54.475338+0000","last_clean":"2024-04-25T12:50:54.475338+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:54.475338+0000","last_undegraded":"2024-04-25T12:50:54.475338+0000","last_fullsized":"2024-04-25T12:50:54.475338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600579+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:54.600579+0000","last_peered":"2024-04-25T12:50:54.600579+0000","last_clean":"2024-04-25T12:50:54.600579+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:54.600579+0000","last_undegraded":"2024-04-25T12:50:54.600579+0000","last_fullsized":"2024-04-25T12:50:54.600579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479039+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:54.479039+0000","last_peered":"2024-04-25T12:50:54.479039+0000","last_clean":"2024-04-25T12:50:54.479039+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:54.479039+0000","last_undegraded":"2024-04-25T12:50:54.479039+0000","last_fullsized":"2024-04-25T12:50:54.479039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599703+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:54.599703+0000","last_peered":"2024-04-25T12:50:54.599703+0000","last_clean":"2024-04-25T12:50:54.599703+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:54.599703+0000","last_undegraded":"2024-04-25T12:50:54.599703+0000","last_fullsized":"2024-04-25T12:50:54.599703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.604906+0000","last_change":"2024-04-25T12:50:54.600889+0000","last_active":"2024-04-25T12:50:54.604906+0000","last_peered":"2024-04-25T12:50:54.604906+0000","last_clean":"2024-04-25T12:50:54.604906+0000","last_became_active":"2024-04-25T12:50:54.600590+0000","last_became_peered":"2024-04-25T12:50:54.600590+0000","last_unstale":"2024-04-25T12:50:54.604906+0000","last_undegraded":"2024-04-25T12:50:54.604906+0000","last_fullsized":"2024-04-25T12:50:54.604906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:35.493159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478655+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:54.478655+0000","last_peered":"2024-04-25T12:50:54.478655+0000","last_clean":"2024-04-25T12:50:54.478655+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:54.478655+0000","last_undegraded":"2024-04-25T12:50:54.478655+0000","last_fullsized":"2024-04-25T12:50:54.478655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475148+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:54.475148+0000","last_peered":"2024-04-25T12:50:54.475148+0000","last_clean":"2024-04-25T12:50:54.475148+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:54.475148+0000","last_undegraded":"2024-04-25T12:50:54.475148+0000","last_fullsized":"2024-04-25T12:50:54.475148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600079+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:54.600079+0000","last_peered":"2024-04-25T12:50:54.600079+0000","last_clean":"2024-04-25T12:50:54.600079+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:54.600079+0000","last_undegraded":"2024-04-25T12:50:54.600079+0000","last_fullsized":"2024-04-25T12:50:54.600079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480451+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:54.480451+0000","last_peered":"2024-04-25T12:50:54.480451+0000","last_clean":"2024-04-25T12:50:54.480451+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:54.480451+0000","last_undegraded":"2024-04-25T12:50:54.480451+0000","last_fullsized":"2024-04-25T12:50:54.480451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.485570+0000","last_change":"2024-04-25T12:50:54.481281+0000","last_active":"2024-04-25T12:50:54.485570+0000","last_peered":"2024-04-25T12:50:54.485570+0000","last_clean":"2024-04-25T12:50:54.485570+0000","last_became_active":"2024-04-25T12:50:54.481059+0000","last_became_peered":"2024-04-25T12:50:54.481059+0000","last_unstale":"2024-04-25T12:50:54.485570+0000","last_undegraded":"2024-04-25T12:50:54.485570+0000","last_fullsized":"2024-04-25T12:50:54.485570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:19.251292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478592+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:54.478592+0000","last_peered":"2024-04-25T12:50:54.478592+0000","last_clean":"2024-04-25T12:50:54.478592+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:54.478592+0000","last_undegraded":"2024-04-25T12:50:54.478592+0000","last_fullsized":"2024-04-25T12:50:54.478592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599472+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:54.599472+0000","last_peered":"2024-04-25T12:50:54.599472+0000","last_clean":"2024-04-25T12:50:54.599472+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:54.599472+0000","last_undegraded":"2024-04-25T12:50:54.599472+0000","last_fullsized":"2024-04-25T12:50:54.599472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477863+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:54.477863+0000","last_peered":"2024-04-25T12:50:54.477863+0000","last_clean":"2024-04-25T12:50:54.477863+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:54.477863+0000","last_undegraded":"2024-04-25T12:50:54.477863+0000","last_fullsized":"2024-04-25T12:50:54.477863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475335+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:54.475335+0000","last_peered":"2024-04-25T12:50:54.475335+0000","last_clean":"2024-04-25T12:50:54.475335+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:54.475335+0000","last_undegraded":"2024-04-25T12:50:54.475335+0000","last_fullsized":"2024-04-25T12:50:54.475335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600467+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:54.600467+0000","last_peered":"2024-04-25T12:50:54.600467+0000","last_clean":"2024-04-25T12:50:54.600467+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:54.600467+0000","last_undegraded":"2024-04-25T12:50:54.600467+0000","last_fullsized":"2024-04-25T12:50:54.600467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599016+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:54.599016+0000","last_peered":"2024-04-25T12:50:54.599016+0000","last_clean":"2024-04-25T12:50:54.599016+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:54.599016+0000","last_undegraded":"2024-04-25T12:50:54.599016+0000","last_fullsized":"2024-04-25T12:50:54.599016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599533+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:54.599533+0000","last_peered":"2024-04-25T12:50:54.599533+0000","last_clean":"2024-04-25T12:50:54.599533+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:54.599533+0000","last_undegraded":"2024-04-25T12:50:54.599533+0000","last_fullsized":"2024-04-25T12:50:54.599533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479446+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:54.479446+0000","last_peered":"2024-04-25T12:50:54.479446+0000","last_clean":"2024-04-25T12:50:54.479446+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:54.479446+0000","last_undegraded":"2024-04-25T12:50:54.479446+0000","last_fullsized":"2024-04-25T12:50:54.479446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599664+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:54.599664+0000","last_peered":"2024-04-25T12:50:54.599664+0000","last_clean":"2024-04-25T12:50:54.599664+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:54.599664+0000","last_undegraded":"2024-04-25T12:50:54.599664+0000","last_fullsized":"2024-04-25T12:50:54.599664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479221+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:54.479221+0000","last_peered":"2024-04-25T12:50:54.479221+0000","last_clean":"2024-04-25T12:50:54.479221+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:54.479221+0000","last_undegraded":"2024-04-25T12:50:54.479221+0000","last_fullsized":"2024-04-25T12:50:54.479221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478790+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:54.478790+0000","last_peered":"2024-04-25T12:50:54.478790+0000","last_clean":"2024-04-25T12:50:54.478790+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:54.478790+0000","last_undegraded":"2024-04-25T12:50:54.478790+0000","last_fullsized":"2024-04-25T12:50:54.478790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600065+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:54.600065+0000","last_peered":"2024-04-25T12:50:54.600065+0000","last_clean":"2024-04-25T12:50:54.600065+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:54.600065+0000","last_undegraded":"2024-04-25T12:50:54.600065+0000","last_fullsized":"2024-04-25T12:50:54.600065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600380+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:54.600380+0000","last_peered":"2024-04-25T12:50:54.600380+0000","last_clean":"2024-04-25T12:50:54.600380+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:54.600380+0000","last_undegraded":"2024-04-25T12:50:54.600380+0000","last_fullsized":"2024-04-25T12:50:54.600380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":709565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":702513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":122657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":118649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":115661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":111563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:57.623 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T12:50:57.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:50:57.755 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.756+0000 7fd48df68640 1 Processor -- start 2024-04-25T12:50:57.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.756+0000 7fd48df68640 1 -- start start 2024-04-25T12:50:57.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd48df68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd48806e6e0 0x7fd4880c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd48df68640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd48806eac0 0x7fd488073920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.758 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd48df68640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd488071940 0x7fd488157700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd48df68640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fd4880c80e0 con 0x7fd48806eac0 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd48df68640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd488158000 con 0x7fd488071940 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd48df68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd4881582a0 con 0x7fd48806e6e0 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd48806eac0 0x7fd488073920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd48806eac0 0x7fd488073920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54102/0 (socket says 172.21.15.132:54102) 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 -- 172.21.15.132:0/1682704077 learned_addr learned my addr 172.21.15.132:0/1682704077 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd487fff640 1 --2- 172.21.15.132:0/1682704077 >> v2:172.21.15.157:3300/0 conn(0x7fd488071940 0x7fd488157700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd4877fe640 1 --2- 172.21.15.132:0/1682704077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd48806e6e0 0x7fd4880c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 -- 172.21.15.132:0/1682704077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd48806e6e0 msgr2=0x7fd4880c7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 --2- 172.21.15.132:0/1682704077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd48806e6e0 0x7fd4880c7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 -- 172.21.15.132:0/1682704077 >> v2:172.21.15.157:3300/0 conn(0x7fd488071940 msgr2=0x7fd488157700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 --2- 172.21.15.132:0/1682704077 >> v2:172.21.15.157:3300/0 conn(0x7fd488071940 0x7fd488157700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.757+0000 7fd486ffd640 1 -- 172.21.15.132:0/1682704077 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd488158580 con 0x7fd48806eac0 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.758+0000 7fd486ffd640 1 --2- 172.21.15.132:0/1682704077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd488073920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd4880c6b20 tx=0x7fd47c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd24a5e4ad7f9686 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.758+0000 7fd4867fc640 1 -- 172.21.15.132:0/1682704077 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c037070 con 0x7fd48806eac0 2024-04-25T12:50:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.758+0000 7fd4867fc640 1 -- 172.21.15.132:0/1682704077 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c032440 con 0x7fd48806eac0 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.758+0000 7fd4867fc640 1 -- 172.21.15.132:0/1682704077 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c032810 con 0x7fd48806eac0 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 -- 172.21.15.132:0/1682704077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 msgr2=0x7fd488073920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 --2- 172.21.15.132:0/1682704077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd488073920 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd4880c6b20 tx=0x7fd47c02a270 comp rx=0 tx=0).stop 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 -- 172.21.15.132:0/1682704077 shutdown_connections 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 --2- 172.21.15.132:0/1682704077 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd488073920 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 --2- 172.21.15.132:0/1682704077 >> v2:172.21.15.157:3300/0 conn(0x7fd488071940 0x7fd488157700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 --2- 172.21.15.132:0/1682704077 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd48806e6e0 0x7fd4880c7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 -- 172.21.15.132:0/1682704077 >> 172.21.15.132:0/1682704077 conn(0x7fd488067630 msgr2=0x7fd488067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:57.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 -- 172.21.15.132:0/1682704077 shutdown_connections 2024-04-25T12:50:57.762 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.759+0000 7fd48df68640 1 -- 172.21.15.132:0/1682704077 wait complete. 2024-04-25T12:50:57.764 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.760+0000 7fd48df68640 1 Processor -- start 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.760+0000 7fd48df68640 1 -- start start 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd48df68640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd48806e6e0 0x7fd4880c1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd48df68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd4880cb380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd48df68640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd488071940 0x7fd4880cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd48df68640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880c7680 con 0x7fd48806eac0 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd48df68640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd4880c73a0 con 0x7fd48806e6e0 2024-04-25T12:50:57.765 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd48df68640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd488073e60 con 0x7fd488071940 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd4880cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd4880cb380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54118/0 (socket says 172.21.15.132:54118) 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 -- 172.21.15.132:0/3183546565 learned_addr learned my addr 172.21.15.132:0/3183546565 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd4877fe640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd48806e6e0 0x7fd4880c1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd487fff640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd488071940 0x7fd4880cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 -- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd488071940 msgr2=0x7fd4880cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd488071940 0x7fd4880cb8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.766 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 -- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd48806e6e0 msgr2=0x7fd4880c1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd48806e6e0 0x7fd4880c1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 -- 172.21.15.132:0/3183546565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4880c57c0 con 0x7fd48806eac0 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.761+0000 7fd486ffd640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd4880cb380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd47c02a2b0 tx=0x7fd47c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.762+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c041020 con 0x7fd48806eac0 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.762+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd47c03d620 con 0x7fd48806eac0 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.762+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4880c5aa0 con 0x7fd48806eac0 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.762+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47c037040 con 0x7fd48806eac0 2024-04-25T12:50:57.767 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.762+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4880cab80 con 0x7fd48806eac0 2024-04-25T12:50:57.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.763+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd488068c20 con 0x7fd48806eac0 2024-04-25T12:50:57.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.763+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd47c044020 con 0x7fd48806eac0 2024-04-25T12:50:57.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.763+0000 7fd46ffff640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd47406c8f0 0x7fd47406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:57.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.764+0000 7fd4877fe640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd47406c8f0 0x7fd47406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:57.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.764+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fd47c0ac5a0 con 0x7fd48806eac0 2024-04-25T12:50:57.768 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.764+0000 7fd4877fe640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd47406c8f0 0x7fd47406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd478009ac0 tx=0x7fd478009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:57.769 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.768+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd47c04b030 con 0x7fd48806eac0 2024-04-25T12:50:57.941 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.941+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd488073570 con 0x7fd47406c8f0 2024-04-25T12:50:57.948 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.949+0000 7fd46ffff640 1 -- 172.21.15.132:0/3183546565 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7fd488073570 con 0x7fd47406c8f0 2024-04-25T12:50:57.952 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:57.953 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:50:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd47406c8f0 msgr2=0x7fd47406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd47406c8f0 0x7fd47406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd478009ac0 tx=0x7fd478009190 comp rx=0 tx=0).stop 2024-04-25T12:50:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 msgr2=0x7fd4880cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd4880cb380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fd47c02a2b0 tx=0x7fd47c0046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 shutdown_connections 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd47406c8f0 0x7fd47406edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd488071940 0x7fd4880cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd48806eac0 0x7fd4880cb380 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 --2- 172.21.15.132:0/3183546565 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd48806e6e0 0x7fd4880c1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 >> 172.21.15.132:0/3183546565 conn(0x7fd488067630 msgr2=0x7fd4880cc6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 shutdown_connections 2024-04-25T12:50:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:57.952+0000 7fd48df68640 1 -- 172.21.15.132:0/3183546565 wait complete. 2024-04-25T12:50:57.962 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-04-25T12:50:57.136905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595264,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":209,"num_write_kb":2436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":325,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232084,"kb_used_data":3428,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742636,"statfs":{"total":773094113280,"available":772856459264,"internally_reserved":0,"allocated":3510272,"data_stored":2118012,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":256,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001430"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479195+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:54.479195+0000","last_peered":"2024-04-25T12:50:54.479195+0000","last_clean":"2024-04-25T12:50:54.479195+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:54.479195+0000","last_undegraded":"2024-04-25T12:50:54.479195+0000","last_fullsized":"2024-04-25T12:50:54.479195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600202+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:54.600202+0000","last_peered":"2024-04-25T12:50:54.600202+0000","last_clean":"2024-04-25T12:50:54.600202+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:54.600202+0000","last_undegraded":"2024-04-25T12:50:54.600202+0000","last_fullsized":"2024-04-25T12:50:54.600202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599272+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:54.599272+0000","last_peered":"2024-04-25T12:50:54.599272+0000","last_clean":"2024-04-25T12:50:54.599272+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:54.599272+0000","last_undegraded":"2024-04-25T12:50:54.599272+0000","last_fullsized":"2024-04-25T12:50:54.599272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600386+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:54.600386+0000","last_peered":"2024-04-25T12:50:54.600386+0000","last_clean":"2024-04-25T12:50:54.600386+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:54.600386+0000","last_undegraded":"2024-04-25T12:50:54.600386+0000","last_fullsized":"2024-04-25T12:50:54.600386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602722+0000","last_change":"2024-04-25T12:50:54.602722+0000","last_active":"2024-04-25T12:50:54.602722+0000","last_peered":"2024-04-25T12:50:54.602722+0000","last_clean":"2024-04-25T12:50:54.602722+0000","last_became_active":"2024-04-25T12:50:54.602420+0000","last_became_peered":"2024-04-25T12:50:54.602420+0000","last_unstale":"2024-04-25T12:50:54.602722+0000","last_undegraded":"2024-04-25T12:50:54.602722+0000","last_fullsized":"2024-04-25T12:50:54.602722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:56.779821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477099+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:54.477099+0000","last_peered":"2024-04-25T12:50:54.477099+0000","last_clean":"2024-04-25T12:50:54.477099+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:54.477099+0000","last_undegraded":"2024-04-25T12:50:54.477099+0000","last_fullsized":"2024-04-25T12:50:54.477099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600037+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:54.600037+0000","last_peered":"2024-04-25T12:50:54.600037+0000","last_clean":"2024-04-25T12:50:54.600037+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:54.600037+0000","last_undegraded":"2024-04-25T12:50:54.600037+0000","last_fullsized":"2024-04-25T12:50:54.600037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479322+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:54.479322+0000","last_peered":"2024-04-25T12:50:54.479322+0000","last_clean":"2024-04-25T12:50:54.479322+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:54.479322+0000","last_undegraded":"2024-04-25T12:50:54.479322+0000","last_fullsized":"2024-04-25T12:50:54.479322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477511+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:54.477511+0000","last_peered":"2024-04-25T12:50:54.477511+0000","last_clean":"2024-04-25T12:50:54.477511+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:54.477511+0000","last_undegraded":"2024-04-25T12:50:54.477511+0000","last_fullsized":"2024-04-25T12:50:54.477511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599777+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:54.599777+0000","last_peered":"2024-04-25T12:50:54.599777+0000","last_clean":"2024-04-25T12:50:54.599777+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:54.599777+0000","last_undegraded":"2024-04-25T12:50:54.599777+0000","last_fullsized":"2024-04-25T12:50:54.599777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479735+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:54.479735+0000","last_peered":"2024-04-25T12:50:54.479735+0000","last_clean":"2024-04-25T12:50:54.479735+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:54.479735+0000","last_undegraded":"2024-04-25T12:50:54.479735+0000","last_fullsized":"2024-04-25T12:50:54.479735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477367+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:54.477367+0000","last_peered":"2024-04-25T12:50:54.477367+0000","last_clean":"2024-04-25T12:50:54.477367+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:54.477367+0000","last_undegraded":"2024-04-25T12:50:54.477367+0000","last_fullsized":"2024-04-25T12:50:54.477367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474699+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:54.474699+0000","last_peered":"2024-04-25T12:50:54.474699+0000","last_clean":"2024-04-25T12:50:54.474699+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:54.474699+0000","last_undegraded":"2024-04-25T12:50:54.474699+0000","last_fullsized":"2024-04-25T12:50:54.474699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599849+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:54.599849+0000","last_peered":"2024-04-25T12:50:54.599849+0000","last_clean":"2024-04-25T12:50:54.599849+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:54.599849+0000","last_undegraded":"2024-04-25T12:50:54.599849+0000","last_fullsized":"2024-04-25T12:50:54.599849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477799+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:54.477799+0000","last_peered":"2024-04-25T12:50:54.477799+0000","last_clean":"2024-04-25T12:50:54.477799+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:54.477799+0000","last_undegraded":"2024-04-25T12:50:54.477799+0000","last_fullsized":"2024-04-25T12:50:54.477799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600162+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:54.600162+0000","last_peered":"2024-04-25T12:50:54.600162+0000","last_clean":"2024-04-25T12:50:54.600162+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:54.600162+0000","last_undegraded":"2024-04-25T12:50:54.600162+0000","last_fullsized":"2024-04-25T12:50:54.600162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601620+0000","last_change":"2024-04-25T12:50:54.601620+0000","last_active":"2024-04-25T12:50:54.601620+0000","last_peered":"2024-04-25T12:50:54.601620+0000","last_clean":"2024-04-25T12:50:54.601620+0000","last_became_active":"2024-04-25T12:50:54.601163+0000","last_became_peered":"2024-04-25T12:50:54.601163+0000","last_unstale":"2024-04-25T12:50:54.601620+0000","last_undegraded":"2024-04-25T12:50:54.601620+0000","last_fullsized":"2024-04-25T12:50:54.601620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:02.679362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599233+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:54.599233+0000","last_peered":"2024-04-25T12:50:54.599233+0000","last_clean":"2024-04-25T12:50:54.599233+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:54.599233+0000","last_undegraded":"2024-04-25T12:50:54.599233+0000","last_fullsized":"2024-04-25T12:50:54.599233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600288+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:54.600288+0000","last_peered":"2024-04-25T12:50:54.600288+0000","last_clean":"2024-04-25T12:50:54.600288+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:54.600288+0000","last_undegraded":"2024-04-25T12:50:54.600288+0000","last_fullsized":"2024-04-25T12:50:54.600288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600400+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:54.600400+0000","last_peered":"2024-04-25T12:50:54.600400+0000","last_clean":"2024-04-25T12:50:54.600400+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:54.600400+0000","last_undegraded":"2024-04-25T12:50:54.600400+0000","last_fullsized":"2024-04-25T12:50:54.600400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478229+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:54.478229+0000","last_peered":"2024-04-25T12:50:54.478229+0000","last_clean":"2024-04-25T12:50:54.478229+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:54.478229+0000","last_undegraded":"2024-04-25T12:50:54.478229+0000","last_fullsized":"2024-04-25T12:50:54.478229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599368+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:54.599368+0000","last_peered":"2024-04-25T12:50:54.599368+0000","last_clean":"2024-04-25T12:50:54.599368+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:54.599368+0000","last_undegraded":"2024-04-25T12:50:54.599368+0000","last_fullsized":"2024-04-25T12:50:54.599368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478354+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:54.478354+0000","last_peered":"2024-04-25T12:50:54.478354+0000","last_clean":"2024-04-25T12:50:54.478354+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:54.478354+0000","last_undegraded":"2024-04-25T12:50:54.478354+0000","last_fullsized":"2024-04-25T12:50:54.478354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478968+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:54.478968+0000","last_peered":"2024-04-25T12:50:54.478968+0000","last_clean":"2024-04-25T12:50:54.478968+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:54.478968+0000","last_undegraded":"2024-04-25T12:50:54.478968+0000","last_fullsized":"2024-04-25T12:50:54.478968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475142+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:54.475142+0000","last_peered":"2024-04-25T12:50:54.475142+0000","last_clean":"2024-04-25T12:50:54.475142+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:54.475142+0000","last_undegraded":"2024-04-25T12:50:54.475142+0000","last_fullsized":"2024-04-25T12:50:54.475142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478073+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:54.478073+0000","last_peered":"2024-04-25T12:50:54.478073+0000","last_clean":"2024-04-25T12:50:54.478073+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:54.478073+0000","last_undegraded":"2024-04-25T12:50:54.478073+0000","last_fullsized":"2024-04-25T12:50:54.478073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600661+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:54.600661+0000","last_peered":"2024-04-25T12:50:54.600661+0000","last_clean":"2024-04-25T12:50:54.600661+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:54.600661+0000","last_undegraded":"2024-04-25T12:50:54.600661+0000","last_fullsized":"2024-04-25T12:50:54.600661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600151+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:54.600151+0000","last_peered":"2024-04-25T12:50:54.600151+0000","last_clean":"2024-04-25T12:50:54.600151+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:54.600151+0000","last_undegraded":"2024-04-25T12:50:54.600151+0000","last_fullsized":"2024-04-25T12:50:54.600151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.598907+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:54.598907+0000","last_peered":"2024-04-25T12:50:54.598907+0000","last_clean":"2024-04-25T12:50:54.598907+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:54.598907+0000","last_undegraded":"2024-04-25T12:50:54.598907+0000","last_fullsized":"2024-04-25T12:50:54.598907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600154+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:54.600154+0000","last_peered":"2024-04-25T12:50:54.600154+0000","last_clean":"2024-04-25T12:50:54.600154+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:54.600154+0000","last_undegraded":"2024-04-25T12:50:54.600154+0000","last_fullsized":"2024-04-25T12:50:54.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600170+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:54.600170+0000","last_peered":"2024-04-25T12:50:54.600170+0000","last_clean":"2024-04-25T12:50:54.600170+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:54.600170+0000","last_undegraded":"2024-04-25T12:50:54.600170+0000","last_fullsized":"2024-04-25T12:50:54.600170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478601+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:54.478601+0000","last_peered":"2024-04-25T12:50:54.478601+0000","last_clean":"2024-04-25T12:50:54.478601+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:54.478601+0000","last_undegraded":"2024-04-25T12:50:54.478601+0000","last_fullsized":"2024-04-25T12:50:54.478601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480012+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:54.480012+0000","last_peered":"2024-04-25T12:50:54.480012+0000","last_clean":"2024-04-25T12:50:54.480012+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:54.480012+0000","last_undegraded":"2024-04-25T12:50:54.480012+0000","last_fullsized":"2024-04-25T12:50:54.480012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600254+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:54.600254+0000","last_peered":"2024-04-25T12:50:54.600254+0000","last_clean":"2024-04-25T12:50:54.600254+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:54.600254+0000","last_undegraded":"2024-04-25T12:50:54.600254+0000","last_fullsized":"2024-04-25T12:50:54.600254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599823+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:54.599823+0000","last_peered":"2024-04-25T12:50:54.599823+0000","last_clean":"2024-04-25T12:50:54.599823+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:54.599823+0000","last_undegraded":"2024-04-25T12:50:54.599823+0000","last_fullsized":"2024-04-25T12:50:54.599823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477890+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:54.477890+0000","last_peered":"2024-04-25T12:50:54.477890+0000","last_clean":"2024-04-25T12:50:54.477890+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:54.477890+0000","last_undegraded":"2024-04-25T12:50:54.477890+0000","last_fullsized":"2024-04-25T12:50:54.477890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479691+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:54.479691+0000","last_peered":"2024-04-25T12:50:54.479691+0000","last_clean":"2024-04-25T12:50:54.479691+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:54.479691+0000","last_undegraded":"2024-04-25T12:50:54.479691+0000","last_fullsized":"2024-04-25T12:50:54.479691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599847+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:54.599847+0000","last_peered":"2024-04-25T12:50:54.599847+0000","last_clean":"2024-04-25T12:50:54.599847+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:54.599847+0000","last_undegraded":"2024-04-25T12:50:54.599847+0000","last_fullsized":"2024-04-25T12:50:54.599847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599531+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:54.599531+0000","last_peered":"2024-04-25T12:50:54.599531+0000","last_clean":"2024-04-25T12:50:54.599531+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:54.599531+0000","last_undegraded":"2024-04-25T12:50:54.599531+0000","last_fullsized":"2024-04-25T12:50:54.599531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476542+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:54.476542+0000","last_peered":"2024-04-25T12:50:54.476542+0000","last_clean":"2024-04-25T12:50:54.476542+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:54.476542+0000","last_undegraded":"2024-04-25T12:50:54.476542+0000","last_fullsized":"2024-04-25T12:50:54.476542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600495+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:54.600495+0000","last_peered":"2024-04-25T12:50:54.600495+0000","last_clean":"2024-04-25T12:50:54.600495+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:54.600495+0000","last_undegraded":"2024-04-25T12:50:54.600495+0000","last_fullsized":"2024-04-25T12:50:54.600495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478363+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:54.478363+0000","last_peered":"2024-04-25T12:50:54.478363+0000","last_clean":"2024-04-25T12:50:54.478363+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:54.478363+0000","last_undegraded":"2024-04-25T12:50:54.478363+0000","last_fullsized":"2024-04-25T12:50:54.478363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599446+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:54.599446+0000","last_peered":"2024-04-25T12:50:54.599446+0000","last_clean":"2024-04-25T12:50:54.599446+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:54.599446+0000","last_undegraded":"2024-04-25T12:50:54.599446+0000","last_fullsized":"2024-04-25T12:50:54.599446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601447+0000","last_change":"2024-04-25T12:50:54.601447+0000","last_active":"2024-04-25T12:50:54.601447+0000","last_peered":"2024-04-25T12:50:54.601447+0000","last_clean":"2024-04-25T12:50:54.601447+0000","last_became_active":"2024-04-25T12:50:54.601056+0000","last_became_peered":"2024-04-25T12:50:54.601056+0000","last_unstale":"2024-04-25T12:50:54.601447+0000","last_undegraded":"2024-04-25T12:50:54.601447+0000","last_fullsized":"2024-04-25T12:50:54.601447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:00.221828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599271+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:54.599271+0000","last_peered":"2024-04-25T12:50:54.599271+0000","last_clean":"2024-04-25T12:50:54.599271+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:54.599271+0000","last_undegraded":"2024-04-25T12:50:54.599271+0000","last_fullsized":"2024-04-25T12:50:54.599271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479375+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:54.479375+0000","last_peered":"2024-04-25T12:50:54.479375+0000","last_clean":"2024-04-25T12:50:54.479375+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:54.479375+0000","last_undegraded":"2024-04-25T12:50:54.479375+0000","last_fullsized":"2024-04-25T12:50:54.479375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599510+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:54.599510+0000","last_peered":"2024-04-25T12:50:54.599510+0000","last_clean":"2024-04-25T12:50:54.599510+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:54.599510+0000","last_undegraded":"2024-04-25T12:50:54.599510+0000","last_fullsized":"2024-04-25T12:50:54.599510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474978+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:54.474978+0000","last_peered":"2024-04-25T12:50:54.474978+0000","last_clean":"2024-04-25T12:50:54.474978+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:54.474978+0000","last_undegraded":"2024-04-25T12:50:54.474978+0000","last_fullsized":"2024-04-25T12:50:54.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599883+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:54.599883+0000","last_peered":"2024-04-25T12:50:54.599883+0000","last_clean":"2024-04-25T12:50:54.599883+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:54.599883+0000","last_undegraded":"2024-04-25T12:50:54.599883+0000","last_fullsized":"2024-04-25T12:50:54.599883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474733+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:54.474733+0000","last_peered":"2024-04-25T12:50:54.474733+0000","last_clean":"2024-04-25T12:50:54.474733+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:54.474733+0000","last_undegraded":"2024-04-25T12:50:54.474733+0000","last_fullsized":"2024-04-25T12:50:54.474733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479406+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:54.479406+0000","last_peered":"2024-04-25T12:50:54.479406+0000","last_clean":"2024-04-25T12:50:54.479406+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:54.479406+0000","last_undegraded":"2024-04-25T12:50:54.479406+0000","last_fullsized":"2024-04-25T12:50:54.479406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599921+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:54.599921+0000","last_peered":"2024-04-25T12:50:54.599921+0000","last_clean":"2024-04-25T12:50:54.599921+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:54.599921+0000","last_undegraded":"2024-04-25T12:50:54.599921+0000","last_fullsized":"2024-04-25T12:50:54.599921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478719+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:54.478719+0000","last_peered":"2024-04-25T12:50:54.478719+0000","last_clean":"2024-04-25T12:50:54.478719+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:54.478719+0000","last_undegraded":"2024-04-25T12:50:54.478719+0000","last_fullsized":"2024-04-25T12:50:54.478719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600500+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:54.600500+0000","last_peered":"2024-04-25T12:50:54.600500+0000","last_clean":"2024-04-25T12:50:54.600500+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:54.600500+0000","last_undegraded":"2024-04-25T12:50:54.600500+0000","last_fullsized":"2024-04-25T12:50:54.600500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476341+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:54.476341+0000","last_peered":"2024-04-25T12:50:54.476341+0000","last_clean":"2024-04-25T12:50:54.476341+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:54.476341+0000","last_undegraded":"2024-04-25T12:50:54.476341+0000","last_fullsized":"2024-04-25T12:50:54.476341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478904+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:54.478904+0000","last_peered":"2024-04-25T12:50:54.478904+0000","last_clean":"2024-04-25T12:50:54.478904+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:54.478904+0000","last_undegraded":"2024-04-25T12:50:54.478904+0000","last_fullsized":"2024-04-25T12:50:54.478904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600300+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:54.600300+0000","last_peered":"2024-04-25T12:50:54.600300+0000","last_clean":"2024-04-25T12:50:54.600300+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:54.600300+0000","last_undegraded":"2024-04-25T12:50:54.600300+0000","last_fullsized":"2024-04-25T12:50:54.600300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478701+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:54.478701+0000","last_peered":"2024-04-25T12:50:54.478701+0000","last_clean":"2024-04-25T12:50:54.478701+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:54.478701+0000","last_undegraded":"2024-04-25T12:50:54.478701+0000","last_fullsized":"2024-04-25T12:50:54.478701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602094+0000","last_change":"2024-04-25T12:50:54.602094+0000","last_active":"2024-04-25T12:50:54.602094+0000","last_peered":"2024-04-25T12:50:54.602094+0000","last_clean":"2024-04-25T12:50:54.602094+0000","last_became_active":"2024-04-25T12:50:54.601336+0000","last_became_peered":"2024-04-25T12:50:54.601336+0000","last_unstale":"2024-04-25T12:50:54.602094+0000","last_undegraded":"2024-04-25T12:50:54.602094+0000","last_fullsized":"2024-04-25T12:50:54.602094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:50.002160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.483087+0000","last_change":"2024-04-25T12:50:54.479164+0000","last_active":"2024-04-25T12:50:54.483087+0000","last_peered":"2024-04-25T12:50:54.483087+0000","last_clean":"2024-04-25T12:50:54.483087+0000","last_became_active":"2024-04-25T12:50:54.478889+0000","last_became_peered":"2024-04-25T12:50:54.478889+0000","last_unstale":"2024-04-25T12:50:54.483087+0000","last_undegraded":"2024-04-25T12:50:54.483087+0000","last_fullsized":"2024-04-25T12:50:54.483087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:51.351035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475987+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:54.475987+0000","last_peered":"2024-04-25T12:50:54.475987+0000","last_clean":"2024-04-25T12:50:54.475987+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:54.475987+0000","last_undegraded":"2024-04-25T12:50:54.475987+0000","last_fullsized":"2024-04-25T12:50:54.475987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478799+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:54.478799+0000","last_peered":"2024-04-25T12:50:54.478799+0000","last_clean":"2024-04-25T12:50:54.478799+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:54.478799+0000","last_undegraded":"2024-04-25T12:50:54.478799+0000","last_fullsized":"2024-04-25T12:50:54.478799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474617+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:54.474617+0000","last_peered":"2024-04-25T12:50:54.474617+0000","last_clean":"2024-04-25T12:50:54.474617+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:54.474617+0000","last_undegraded":"2024-04-25T12:50:54.474617+0000","last_fullsized":"2024-04-25T12:50:54.474617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474706+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:54.474706+0000","last_peered":"2024-04-25T12:50:54.474706+0000","last_clean":"2024-04-25T12:50:54.474706+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:54.474706+0000","last_undegraded":"2024-04-25T12:50:54.474706+0000","last_fullsized":"2024-04-25T12:50:54.474706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600491+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:54.600491+0000","last_peered":"2024-04-25T12:50:54.600491+0000","last_clean":"2024-04-25T12:50:54.600491+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:54.600491+0000","last_undegraded":"2024-04-25T12:50:54.600491+0000","last_fullsized":"2024-04-25T12:50:54.600491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599852+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:54.599852+0000","last_peered":"2024-04-25T12:50:54.599852+0000","last_clean":"2024-04-25T12:50:54.599852+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:54.599852+0000","last_undegraded":"2024-04-25T12:50:54.599852+0000","last_fullsized":"2024-04-25T12:50:54.599852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479586+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:54.479586+0000","last_peered":"2024-04-25T12:50:54.479586+0000","last_clean":"2024-04-25T12:50:54.479586+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:54.479586+0000","last_undegraded":"2024-04-25T12:50:54.479586+0000","last_fullsized":"2024-04-25T12:50:54.479586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599324+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:54.599324+0000","last_peered":"2024-04-25T12:50:54.599324+0000","last_clean":"2024-04-25T12:50:54.599324+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:54.599324+0000","last_undegraded":"2024-04-25T12:50:54.599324+0000","last_fullsized":"2024-04-25T12:50:54.599324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478503+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:54.478503+0000","last_peered":"2024-04-25T12:50:54.478503+0000","last_clean":"2024-04-25T12:50:54.478503+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:54.478503+0000","last_undegraded":"2024-04-25T12:50:54.478503+0000","last_fullsized":"2024-04-25T12:50:54.478503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478971+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:54.478971+0000","last_peered":"2024-04-25T12:50:54.478971+0000","last_clean":"2024-04-25T12:50:54.478971+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:54.478971+0000","last_undegraded":"2024-04-25T12:50:54.478971+0000","last_fullsized":"2024-04-25T12:50:54.478971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479694+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:54.479694+0000","last_peered":"2024-04-25T12:50:54.479694+0000","last_clean":"2024-04-25T12:50:54.479694+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:54.479694+0000","last_undegraded":"2024-04-25T12:50:54.479694+0000","last_fullsized":"2024-04-25T12:50:54.479694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599802+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:54.599802+0000","last_peered":"2024-04-25T12:50:54.599802+0000","last_clean":"2024-04-25T12:50:54.599802+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:54.599802+0000","last_undegraded":"2024-04-25T12:50:54.599802+0000","last_fullsized":"2024-04-25T12:50:54.599802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475248+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:54.475248+0000","last_peered":"2024-04-25T12:50:54.475248+0000","last_clean":"2024-04-25T12:50:54.475248+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:54.475248+0000","last_undegraded":"2024-04-25T12:50:54.475248+0000","last_fullsized":"2024-04-25T12:50:54.475248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4098,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599973+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:54.599973+0000","last_peered":"2024-04-25T12:50:54.599973+0000","last_clean":"2024-04-25T12:50:54.599973+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:54.599973+0000","last_undegraded":"2024-04-25T12:50:54.599973+0000","last_fullsized":"2024-04-25T12:50:54.599973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477988+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:54.477988+0000","last_peered":"2024-04-25T12:50:54.477988+0000","last_clean":"2024-04-25T12:50:54.477988+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:54.477988+0000","last_undegraded":"2024-04-25T12:50:54.477988+0000","last_fullsized":"2024-04-25T12:50:54.477988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599804+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:54.599804+0000","last_peered":"2024-04-25T12:50:54.599804+0000","last_clean":"2024-04-25T12:50:54.599804+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:54.599804+0000","last_undegraded":"2024-04-25T12:50:54.599804+0000","last_fullsized":"2024-04-25T12:50:54.599804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477578+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:54.477578+0000","last_peered":"2024-04-25T12:50:54.477578+0000","last_clean":"2024-04-25T12:50:54.477578+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:54.477578+0000","last_undegraded":"2024-04-25T12:50:54.477578+0000","last_fullsized":"2024-04-25T12:50:54.477578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479101+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:54.479101+0000","last_peered":"2024-04-25T12:50:54.479101+0000","last_clean":"2024-04-25T12:50:54.479101+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:54.479101+0000","last_undegraded":"2024-04-25T12:50:54.479101+0000","last_fullsized":"2024-04-25T12:50:54.479101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480204+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:54.480204+0000","last_peered":"2024-04-25T12:50:54.480204+0000","last_clean":"2024-04-25T12:50:54.480204+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:54.480204+0000","last_undegraded":"2024-04-25T12:50:54.480204+0000","last_fullsized":"2024-04-25T12:50:54.480204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599114+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:54.599114+0000","last_peered":"2024-04-25T12:50:54.599114+0000","last_clean":"2024-04-25T12:50:54.599114+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:54.599114+0000","last_undegraded":"2024-04-25T12:50:54.599114+0000","last_fullsized":"2024-04-25T12:50:54.599114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480208+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:54.480208+0000","last_peered":"2024-04-25T12:50:54.480208+0000","last_clean":"2024-04-25T12:50:54.480208+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:54.480208+0000","last_undegraded":"2024-04-25T12:50:54.480208+0000","last_fullsized":"2024-04-25T12:50:54.480208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599573+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:54.599573+0000","last_peered":"2024-04-25T12:50:54.599573+0000","last_clean":"2024-04-25T12:50:54.599573+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:54.599573+0000","last_undegraded":"2024-04-25T12:50:54.599573+0000","last_fullsized":"2024-04-25T12:50:54.599573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478848+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:54.478848+0000","last_peered":"2024-04-25T12:50:54.478848+0000","last_clean":"2024-04-25T12:50:54.478848+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:54.478848+0000","last_undegraded":"2024-04-25T12:50:54.478848+0000","last_fullsized":"2024-04-25T12:50:54.478848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599456+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:54.599456+0000","last_peered":"2024-04-25T12:50:54.599456+0000","last_clean":"2024-04-25T12:50:54.599456+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:54.599456+0000","last_undegraded":"2024-04-25T12:50:54.599456+0000","last_fullsized":"2024-04-25T12:50:54.599456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479149+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:54.479149+0000","last_peered":"2024-04-25T12:50:54.479149+0000","last_clean":"2024-04-25T12:50:54.479149+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:54.479149+0000","last_undegraded":"2024-04-25T12:50:54.479149+0000","last_fullsized":"2024-04-25T12:50:54.479149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474875+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:54.474875+0000","last_peered":"2024-04-25T12:50:54.474875+0000","last_clean":"2024-04-25T12:50:54.474875+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:54.474875+0000","last_undegraded":"2024-04-25T12:50:54.474875+0000","last_fullsized":"2024-04-25T12:50:54.474875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599136+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:54.599136+0000","last_peered":"2024-04-25T12:50:54.599136+0000","last_clean":"2024-04-25T12:50:54.599136+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:54.599136+0000","last_undegraded":"2024-04-25T12:50:54.599136+0000","last_fullsized":"2024-04-25T12:50:54.599136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599786+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:54.599786+0000","last_peered":"2024-04-25T12:50:54.599786+0000","last_clean":"2024-04-25T12:50:54.599786+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:54.599786+0000","last_undegraded":"2024-04-25T12:50:54.599786+0000","last_fullsized":"2024-04-25T12:50:54.599786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474954+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:54.474954+0000","last_peered":"2024-04-25T12:50:54.474954+0000","last_clean":"2024-04-25T12:50:54.474954+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:54.474954+0000","last_undegraded":"2024-04-25T12:50:54.474954+0000","last_fullsized":"2024-04-25T12:50:54.474954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478999+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:54.478999+0000","last_peered":"2024-04-25T12:50:54.478999+0000","last_clean":"2024-04-25T12:50:54.478999+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:54.478999+0000","last_undegraded":"2024-04-25T12:50:54.478999+0000","last_fullsized":"2024-04-25T12:50:54.478999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476107+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:54.476107+0000","last_peered":"2024-04-25T12:50:54.476107+0000","last_clean":"2024-04-25T12:50:54.476107+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:54.476107+0000","last_undegraded":"2024-04-25T12:50:54.476107+0000","last_fullsized":"2024-04-25T12:50:54.476107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599639+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:54.599639+0000","last_peered":"2024-04-25T12:50:54.599639+0000","last_clean":"2024-04-25T12:50:54.599639+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:54.599639+0000","last_undegraded":"2024-04-25T12:50:54.599639+0000","last_fullsized":"2024-04-25T12:50:54.599639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478180+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:54.478180+0000","last_peered":"2024-04-25T12:50:54.478180+0000","last_clean":"2024-04-25T12:50:54.478180+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:54.478180+0000","last_undegraded":"2024-04-25T12:50:54.478180+0000","last_fullsized":"2024-04-25T12:50:54.478180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600139+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:54.600139+0000","last_peered":"2024-04-25T12:50:54.600139+0000","last_clean":"2024-04-25T12:50:54.600139+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:54.600139+0000","last_undegraded":"2024-04-25T12:50:54.600139+0000","last_fullsized":"2024-04-25T12:50:54.600139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474510+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:54.474510+0000","last_peered":"2024-04-25T12:50:54.474510+0000","last_clean":"2024-04-25T12:50:54.474510+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:54.474510+0000","last_undegraded":"2024-04-25T12:50:54.474510+0000","last_fullsized":"2024-04-25T12:50:54.474510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475994+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:54.475994+0000","last_peered":"2024-04-25T12:50:54.475994+0000","last_clean":"2024-04-25T12:50:54.475994+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:54.475994+0000","last_undegraded":"2024-04-25T12:50:54.475994+0000","last_fullsized":"2024-04-25T12:50:54.475994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.603199+0000","last_change":"2024-04-25T12:50:54.603199+0000","last_active":"2024-04-25T12:50:54.603199+0000","last_peered":"2024-04-25T12:50:54.603199+0000","last_clean":"2024-04-25T12:50:54.603199+0000","last_became_active":"2024-04-25T12:50:54.602588+0000","last_became_peered":"2024-04-25T12:50:54.602588+0000","last_unstale":"2024-04-25T12:50:54.603199+0000","last_undegraded":"2024-04-25T12:50:54.603199+0000","last_fullsized":"2024-04-25T12:50:54.603199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:24.120485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478768+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:54.478768+0000","last_peered":"2024-04-25T12:50:54.478768+0000","last_clean":"2024-04-25T12:50:54.478768+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:54.478768+0000","last_undegraded":"2024-04-25T12:50:54.478768+0000","last_fullsized":"2024-04-25T12:50:54.478768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599589+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:54.599589+0000","last_peered":"2024-04-25T12:50:54.599589+0000","last_clean":"2024-04-25T12:50:54.599589+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:54.599589+0000","last_undegraded":"2024-04-25T12:50:54.599589+0000","last_fullsized":"2024-04-25T12:50:54.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599658+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:54.599658+0000","last_peered":"2024-04-25T12:50:54.599658+0000","last_clean":"2024-04-25T12:50:54.599658+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:54.599658+0000","last_undegraded":"2024-04-25T12:50:54.599658+0000","last_fullsized":"2024-04-25T12:50:54.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475338+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:54.475338+0000","last_peered":"2024-04-25T12:50:54.475338+0000","last_clean":"2024-04-25T12:50:54.475338+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:54.475338+0000","last_undegraded":"2024-04-25T12:50:54.475338+0000","last_fullsized":"2024-04-25T12:50:54.475338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600579+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:54.600579+0000","last_peered":"2024-04-25T12:50:54.600579+0000","last_clean":"2024-04-25T12:50:54.600579+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:54.600579+0000","last_undegraded":"2024-04-25T12:50:54.600579+0000","last_fullsized":"2024-04-25T12:50:54.600579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479039+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:54.479039+0000","last_peered":"2024-04-25T12:50:54.479039+0000","last_clean":"2024-04-25T12:50:54.479039+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:54.479039+0000","last_undegraded":"2024-04-25T12:50:54.479039+0000","last_fullsized":"2024-04-25T12:50:54.479039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599703+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:54.599703+0000","last_peered":"2024-04-25T12:50:54.599703+0000","last_clean":"2024-04-25T12:50:54.599703+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:54.599703+0000","last_undegraded":"2024-04-25T12:50:54.599703+0000","last_fullsized":"2024-04-25T12:50:54.599703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.604906+0000","last_change":"2024-04-25T12:50:54.600889+0000","last_active":"2024-04-25T12:50:54.604906+0000","last_peered":"2024-04-25T12:50:54.604906+0000","last_clean":"2024-04-25T12:50:54.604906+0000","last_became_active":"2024-04-25T12:50:54.600590+0000","last_became_peered":"2024-04-25T12:50:54.600590+0000","last_unstale":"2024-04-25T12:50:54.604906+0000","last_undegraded":"2024-04-25T12:50:54.604906+0000","last_fullsized":"2024-04-25T12:50:54.604906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:35.493159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478655+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:54.478655+0000","last_peered":"2024-04-25T12:50:54.478655+0000","last_clean":"2024-04-25T12:50:54.478655+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:54.478655+0000","last_undegraded":"2024-04-25T12:50:54.478655+0000","last_fullsized":"2024-04-25T12:50:54.478655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475148+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:54.475148+0000","last_peered":"2024-04-25T12:50:54.475148+0000","last_clean":"2024-04-25T12:50:54.475148+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:54.475148+0000","last_undegraded":"2024-04-25T12:50:54.475148+0000","last_fullsized":"2024-04-25T12:50:54.475148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600079+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:54.600079+0000","last_peered":"2024-04-25T12:50:54.600079+0000","last_clean":"2024-04-25T12:50:54.600079+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:54.600079+0000","last_undegraded":"2024-04-25T12:50:54.600079+0000","last_fullsized":"2024-04-25T12:50:54.600079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480451+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:54.480451+0000","last_peered":"2024-04-25T12:50:54.480451+0000","last_clean":"2024-04-25T12:50:54.480451+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:54.480451+0000","last_undegraded":"2024-04-25T12:50:54.480451+0000","last_fullsized":"2024-04-25T12:50:54.480451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.485570+0000","last_change":"2024-04-25T12:50:54.481281+0000","last_active":"2024-04-25T12:50:54.485570+0000","last_peered":"2024-04-25T12:50:54.485570+0000","last_clean":"2024-04-25T12:50:54.485570+0000","last_became_active":"2024-04-25T12:50:54.481059+0000","last_became_peered":"2024-04-25T12:50:54.481059+0000","last_unstale":"2024-04-25T12:50:54.485570+0000","last_undegraded":"2024-04-25T12:50:54.485570+0000","last_fullsized":"2024-04-25T12:50:54.485570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:19.251292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478592+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:54.478592+0000","last_peered":"2024-04-25T12:50:54.478592+0000","last_clean":"2024-04-25T12:50:54.478592+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:54.478592+0000","last_undegraded":"2024-04-25T12:50:54.478592+0000","last_fullsized":"2024-04-25T12:50:54.478592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599472+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:54.599472+0000","last_peered":"2024-04-25T12:50:54.599472+0000","last_clean":"2024-04-25T12:50:54.599472+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:54.599472+0000","last_undegraded":"2024-04-25T12:50:54.599472+0000","last_fullsized":"2024-04-25T12:50:54.599472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477863+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:54.477863+0000","last_peered":"2024-04-25T12:50:54.477863+0000","last_clean":"2024-04-25T12:50:54.477863+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:54.477863+0000","last_undegraded":"2024-04-25T12:50:54.477863+0000","last_fullsized":"2024-04-25T12:50:54.477863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475335+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:54.475335+0000","last_peered":"2024-04-25T12:50:54.475335+0000","last_clean":"2024-04-25T12:50:54.475335+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:54.475335+0000","last_undegraded":"2024-04-25T12:50:54.475335+0000","last_fullsized":"2024-04-25T12:50:54.475335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600467+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:54.600467+0000","last_peered":"2024-04-25T12:50:54.600467+0000","last_clean":"2024-04-25T12:50:54.600467+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:54.600467+0000","last_undegraded":"2024-04-25T12:50:54.600467+0000","last_fullsized":"2024-04-25T12:50:54.600467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599016+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:54.599016+0000","last_peered":"2024-04-25T12:50:54.599016+0000","last_clean":"2024-04-25T12:50:54.599016+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:54.599016+0000","last_undegraded":"2024-04-25T12:50:54.599016+0000","last_fullsized":"2024-04-25T12:50:54.599016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599533+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:54.599533+0000","last_peered":"2024-04-25T12:50:54.599533+0000","last_clean":"2024-04-25T12:50:54.599533+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:54.599533+0000","last_undegraded":"2024-04-25T12:50:54.599533+0000","last_fullsized":"2024-04-25T12:50:54.599533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479446+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:54.479446+0000","last_peered":"2024-04-25T12:50:54.479446+0000","last_clean":"2024-04-25T12:50:54.479446+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:54.479446+0000","last_undegraded":"2024-04-25T12:50:54.479446+0000","last_fullsized":"2024-04-25T12:50:54.479446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599664+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:54.599664+0000","last_peered":"2024-04-25T12:50:54.599664+0000","last_clean":"2024-04-25T12:50:54.599664+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:54.599664+0000","last_undegraded":"2024-04-25T12:50:54.599664+0000","last_fullsized":"2024-04-25T12:50:54.599664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479221+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:54.479221+0000","last_peered":"2024-04-25T12:50:54.479221+0000","last_clean":"2024-04-25T12:50:54.479221+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:54.479221+0000","last_undegraded":"2024-04-25T12:50:54.479221+0000","last_fullsized":"2024-04-25T12:50:54.479221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478790+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:54.478790+0000","last_peered":"2024-04-25T12:50:54.478790+0000","last_clean":"2024-04-25T12:50:54.478790+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:54.478790+0000","last_undegraded":"2024-04-25T12:50:54.478790+0000","last_fullsized":"2024-04-25T12:50:54.478790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600065+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:54.600065+0000","last_peered":"2024-04-25T12:50:54.600065+0000","last_clean":"2024-04-25T12:50:54.600065+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:54.600065+0000","last_undegraded":"2024-04-25T12:50:54.600065+0000","last_fullsized":"2024-04-25T12:50:54.600065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600380+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:54.600380+0000","last_peered":"2024-04-25T12:50:54.600380+0000","last_clean":"2024-04-25T12:50:54.600380+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:54.600380+0000","last_undegraded":"2024-04-25T12:50:54.600380+0000","last_fullsized":"2024-04-25T12:50:54.600380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4896,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":44,"ondisk_log_size":44,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":709565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574861,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32032,"kb_used_data":852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339808,"statfs":{"total":96636764160,"available":96603963392,"internally_reserved":0,"allocated":872448,"data_stored":702513,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":122657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574861,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":118649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":115661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":111563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:50:57.969 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:50:58.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.100+0000 7fbbdcb20640 1 Processor -- start 2024-04-25T12:50:58.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.100+0000 7fbbdcb20640 1 -- start start 2024-04-25T12:50:58.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbdcb20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80cbe50 0x7fbbd815bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:58.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbdcb20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbd8070870 0x7fbbd8070ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:58.101 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbdcb20640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd80cb290 con 0x7fbbd80c89e0 2024-04-25T12:50:58.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbdcb20640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fbbd80c8dc0 con 0x7fbbd8070870 2024-04-25T12:50:58.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbdcb20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd815c270 con 0x7fbbd80cbe50 2024-04-25T12:50:58.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbd8070870 0x7fbbd8070ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:58.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbbd80c89e0 0x7fbbd80cb740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56270/0 (socket says 172.21.15.132:56270) 2024-04-25T12:50:58.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd659c640 1 -- 172.21.15.132:0/950008067 learned_addr learned my addr 172.21.15.132:0/950008067 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:58.102 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd5d9b640 1 --2- 172.21.15.132:0/950008067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80cbe50 0x7fbbd815bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:58.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/950008067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80cbe50 msgr2=0x7fbbd815bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:58.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd6d9d640 1 --2- 172.21.15.132:0/950008067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80cbe50 0x7fbbd815bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/950008067 >> v1:172.21.15.132:6789/0 conn(0x7fbbd80c89e0 legacy=0x7fbbd80cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:58.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/950008067 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd815eaf0 con 0x7fbbd8070870 2024-04-25T12:50:58.103 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.101+0000 7fbbd559a640 1 -- 172.21.15.132:0/950008067 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516798970 0 0) 0x7fbbd80cb290 con 0x7fbbd80c89e0 2024-04-25T12:50:58.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.102+0000 7fbbd6d9d640 1 --2- 172.21.15.132:0/950008067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd8070870 0x7fbbd8070ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009d90 tx=0x7fbbd002a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5df81cb52091d03 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:58.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.102+0000 7fbbd559a640 1 -- 172.21.15.132:0/950008067 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0007740 con 0x7fbbd8070870 2024-04-25T12:50:58.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.102+0000 7fbbd559a640 1 -- 172.21.15.132:0/950008067 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd00078e0 con 0x7fbbd8070870 2024-04-25T12:50:58.107 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.102+0000 7fbbd559a640 1 -- 172.21.15.132:0/950008067 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0007cb0 con 0x7fbbd8070870 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 -- 172.21.15.132:0/950008067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd8070870 msgr2=0x7fbbd8070ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/950008067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd8070870 0x7fbbd8070ce0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbbd0009d90 tx=0x7fbbd002a6f0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 -- 172.21.15.132:0/950008067 shutdown_connections 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/950008067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd8070870 0x7fbbd8070ce0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/950008067 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80cbe50 0x7fbbd815bd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 -- 172.21.15.132:0/950008067 >> 172.21.15.132:0/950008067 conn(0x7fbbd8072f10 msgr2=0x7fbbd8073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 -- 172.21.15.132:0/950008067 shutdown_connections 2024-04-25T12:50:58.108 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.103+0000 7fbbdcb20640 1 -- 172.21.15.132:0/950008067 wait complete. 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.104+0000 7fbbdcb20640 1 Processor -- start 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.104+0000 7fbbdcb20640 1 -- start start 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbdcb20640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbd8070870 0x7fbbd8150590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbdcb20640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80c89e0 0x7fbbd81e6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbdcb20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 0x7fbbd81e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbdcb20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd815f0b0 con 0x7fbbd80cbe50 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbdcb20640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fbbd815e8a0 con 0x7fbbd8070870 2024-04-25T12:50:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbdcb20640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fbbd815f390 con 0x7fbbd80c89e0 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 0x7fbbd81e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 0x7fbbd81e66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54122/0 (socket says 172.21.15.132:54122) 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/3764469724 learned_addr learned my addr 172.21.15.132:0/3764469724 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd659c640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbd8070870 0x7fbbd8150590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd5d9b640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80c89e0 0x7fbbd81e6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80c89e0 msgr2=0x7fbbd81e6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80c89e0 0x7fbbd81e6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbd8070870 msgr2=0x7fbbd8150590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbd8070870 0x7fbbd8150590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd6d9d640 1 -- 172.21.15.132:0/3764469724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd81f16c0 con 0x7fbbd80cbe50 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.105+0000 7fbbd5d9b640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80c89e0 0x7fbbd81e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.106+0000 7fbbd6d9d640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 0x7fbbd81e66c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbbd002ace0 tx=0x7fbbd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.106+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0040030 con 0x7fbbd80cbe50 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.106+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbbd00319c0 con 0x7fbbd80cbe50 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.106+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd81f1980 con 0x7fbbd80cbe50 2024-04-25T12:50:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.106+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbd0031d70 con 0x7fbbd80cbe50 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.106+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbd81f1f40 con 0x7fbbd80cbe50 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.107+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbd8070660 con 0x7fbbd80cbe50 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.107+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fbbd0043030 con 0x7fbbd80cbe50 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.108+0000 7fbbc6ffd640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fbbb806c920 0x7fbbb806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.108+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fbbd00acd90 con 0x7fbbd80cbe50 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.108+0000 7fbbd659c640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fbbb806c920 0x7fbbb806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:58.112 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.108+0000 7fbbd659c640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fbbb806c920 0x7fbbb806ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc000f60 tx=0x7fbbcc007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:58.113 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.112+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbbd8070660 con 0x7fbbd80cbe50 2024-04-25T12:50:58.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.286+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbd8068c20 con 0x7fbbd80cbe50 2024-04-25T12:50:58.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.287+0000 7fbbc6ffd640 1 -- 172.21.15.132:0/3764469724 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18985 (secure 0 0 0) 0x7fbbd007a6c0 con 0x7fbbd80cbe50 2024-04-25T12:50:58.290 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:50:58.290 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":27,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:54.470996+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:50:58.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fbbb806c920 msgr2=0x7fbbb806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:58.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fbbb806c920 0x7fbbb806ede0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc000f60 tx=0x7fbbcc007d50 comp rx=0 tx=0).stop 2024-04-25T12:50:58.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 msgr2=0x7fbbd81e66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 0x7fbbd81e66c0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbbd002ace0 tx=0x7fbbd0004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 shutdown_connections 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fbbb806c920 0x7fbbb806ede0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbd80cbe50 0x7fbbd81e66c0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fbbd80c89e0 0x7fbbd81e6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 --2- 172.21.15.132:0/3764469724 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fbbd8070870 0x7fbbd8150590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:58.292 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 >> 172.21.15.132:0/3764469724 conn(0x7fbbd8072f10 msgr2=0x7fbbd806b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:58.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 shutdown_connections 2024-04-25T12:50:58.293 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:58.289+0000 7fbbdcb20640 1 -- 172.21.15.132:0/3764469724 wait complete. 2024-04-25T12:50:59.300 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T12:50:59.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:50:59.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.414+0000 7fdfa4ce8640 1 Processor -- start 2024-04-25T12:50:59.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.414+0000 7fdfa4ce8640 1 -- start start 2024-04-25T12:50:59.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdfa4ce8640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fdfa0153160 0x7fdfa00caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdfa4ce8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0153540 0x7fdfa015c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdfa4ce8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdfa0073700 0x7fdfa0073b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdfa4ce8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa00c5450 con 0x7fdfa0073700 2024-04-25T12:50:59.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdfa4ce8640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fdfa00c3f70 con 0x7fdfa0153160 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdfa4ce8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa00c4210 con 0x7fdfa0153540 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdfa0073700 0x7fdfa0073b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdfa0073700 0x7fdfa0073b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54128/0 (socket says 172.21.15.132:54128) 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/3979989550 learned_addr learned my addr 172.21.15.132:0/3979989550 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9e59c640 1 --2- 172.21.15.132:0/3979989550 >> v2:172.21.15.157:3300/0 conn(0x7fdfa0153160 0x7fdfa00caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf97fff640 1 --2- 172.21.15.132:0/3979989550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0153540 0x7fdfa015c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/3979989550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0153540 msgr2=0x7fdfa015c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 --2- 172.21.15.132:0/3979989550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0153540 0x7fdfa015c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/3979989550 >> v2:172.21.15.157:3300/0 conn(0x7fdfa0153160 msgr2=0x7fdfa00caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 --2- 172.21.15.132:0/3979989550 >> v2:172.21.15.157:3300/0 conn(0x7fdfa0153160 0x7fdfa00caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.415+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/3979989550 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa00c44d0 con 0x7fdfa0073700 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.416+0000 7fdf9ed9d640 1 --2- 172.21.15.132:0/3979989550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0073700 0x7fdfa0073b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00734c0 tx=0x7fdf9802a610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44a8027bd215048 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.416+0000 7fdf9dd9b640 1 -- 172.21.15.132:0/3979989550 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98036070 con 0x7fdfa0073700 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.416+0000 7fdf9dd9b640 1 -- 172.21.15.132:0/3979989550 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf98031600 con 0x7fdfa0073700 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.416+0000 7fdf9dd9b640 1 -- 172.21.15.132:0/3979989550 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf980319d0 con 0x7fdfa0073700 2024-04-25T12:50:59.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/3979989550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0073700 msgr2=0x7fdfa0073b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/3979989550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0073700 0x7fdfa0073b90 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fdfa00734c0 tx=0x7fdf9802a610 comp rx=0 tx=0).stop 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/3979989550 shutdown_connections 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/3979989550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0073700 0x7fdfa0073b90 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/3979989550 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0153540 0x7fdfa015c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/3979989550 >> v2:172.21.15.157:3300/0 conn(0x7fdfa0153160 0x7fdfa00caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/3979989550 >> 172.21.15.132:0/3979989550 conn(0x7fdfa006faf0 msgr2=0x7fdfa0067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/3979989550 shutdown_connections 2024-04-25T12:50:59.419 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.417+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/3979989550 wait complete. 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.418+0000 7fdfa4ce8640 1 Processor -- start 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.418+0000 7fdfa4ce8640 1 -- start start 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0073700 0x7fdfa01f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfa0153160 0x7fdfa015baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0153540 0x7fdfa01ef260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00ca550 con 0x7fdfa0153540 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa00ca270 con 0x7fdfa0153160 2024-04-25T12:50:59.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa00c4a90 con 0x7fdfa0073700 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0153540 0x7fdfa01ef260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0153540 0x7fdfa01ef260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54136/0 (socket says 172.21.15.132:54136) 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/463368413 learned_addr learned my addr 172.21.15.132:0/463368413 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf97fff640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfa0153160 0x7fdfa015baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9e59c640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0073700 0x7fdfa01f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/463368413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0073700 msgr2=0x7fdfa01f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fdfa0073700 0x7fdfa01f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/463368413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfa0153160 msgr2=0x7fdfa015baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fdfa0153160 0x7fdfa015baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/463368413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa01f2d80 con 0x7fdfa0153540 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf9ed9d640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0153540 0x7fdfa01ef260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009e20 tx=0x7fdf98004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98036050 con 0x7fdfa0153540 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf98042070 con 0x7fdfa0153540 2024-04-25T12:50:59.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa01f24e0 con 0x7fdfa0153540 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98009510 con 0x7fdfa0153540 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.419+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa01eea60 con 0x7fdfa0153540 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.420+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdfa0068da0 con 0x7fdfa0153540 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdf98007bd0 con 0x7fdfa0153540 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf96ffd640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdf8006c920 0x7fdf8006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fdf980aca20 con 0x7fdfa0153540 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf9e59c640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdf8006c920 0x7fdf8006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf96ffd640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7fdf800763b0 0x7fdf80078850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 --> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf9804ae80 con 0x7fdf800763b0 2024-04-25T12:50:59.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.421+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf980b12c0 con 0x7fdfa0153540 2024-04-25T12:50:59.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.422+0000 7fdf97fff640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7fdf800763b0 0x7fdf80078850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.422+0000 7fdf9e59c640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdf8006c920 0x7fdf8006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009ac0 tx=0x7fdf90009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.422+0000 7fdf97fff640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7fdf800763b0 0x7fdf80078850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.427 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.423+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== osd.0 v2:172.21.15.132:6808/3942408497 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf9804ae80 con 0x7fdf800763b0 2024-04-25T12:50:59.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 --> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdfa00b4a90 con 0x7fdf800763b0 2024-04-25T12:50:59.435 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdf96ffd640 1 -- 172.21.15.132:0/463368413 <== osd.0 v2:172.21.15.132:6808/3942408497 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdfa00b4a90 con 0x7fdf800763b0 2024-04-25T12:50:59.436 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:50:59.436 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:50:59.436 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7fdf800763b0 msgr2=0x7fdf80078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6808/3942408497,v1:172.21.15.132:6809/3942408497] conn(0x7fdf800763b0 0x7fdf80078850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdf8006c920 msgr2=0x7fdf8006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fdf8006c920 0x7fdf8006ede0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf90009ac0 tx=0x7fdf90009190 comp rx=0 tx=0).stop 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0153540 msgr2=0x7fdfa01ef260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 --2- 172.21.15.132:0/463368413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdfa0153540 0x7fdfa01ef260 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009e20 tx=0x7fdf98004a40 comp rx=0 tx=0).stop 2024-04-25T12:50:59.437 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdf9ed9d640 1 -- 172.21.15.132:0/463368413 reap_dead start 2024-04-25T12:50:59.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 shutdown_connections 2024-04-25T12:50:59.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 >> 172.21.15.132:0/463368413 conn(0x7fdfa006faf0 msgr2=0x7fdfa0067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 shutdown_connections 2024-04-25T12:50:59.438 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.436+0000 7fdfa4ce8640 1 -- 172.21.15.132:0/463368413 wait complete. 2024-04-25T12:50:59.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T12:50:59.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.545+0000 7f1d5939b640 1 Processor -- start 2024-04-25T12:50:59.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.545+0000 7f1d5939b640 1 -- start start 2024-04-25T12:50:59.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d5939b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540cb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d5939b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d540cc230 0x7f1d54072b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d5939b640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d5415b2e0 con 0x7f1d540730d0 2024-04-25T12:50:59.551 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d5939b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f1d5415b580 con 0x7f1d540cc230 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d5939b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5415b860 con 0x7f1d54155530 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d540cc230 0x7f1d54072b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d540cc230 0x7f1d54072b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54146/0 (socket says 172.21.15.132:54146) 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 -- 172.21.15.132:0/31022369 learned_addr learned my addr 172.21.15.132:0/31022369 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d52ffd640 1 --2- 172.21.15.132:0/31022369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540cb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 -- 172.21.15.132:0/31022369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 msgr2=0x7f1d540cb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 --2- 172.21.15.132:0/31022369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540cb310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.552 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 -- 172.21.15.132:0/31022369 >> v1:172.21.15.157:6789/0 conn(0x7f1d540730d0 legacy=0x7f1d5415ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.546+0000 7f1d4bfff640 1 -- 172.21.15.132:0/31022369 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5415bb40 con 0x7f1d540cc230 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.547+0000 7f1d4bfff640 1 --2- 172.21.15.132:0/31022369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54072b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2833ee1c31dbd4a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.547+0000 7f1d527fc640 1 -- 172.21.15.132:0/31022369 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c037070 con 0x7f1d540cc230 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.547+0000 7f1d527fc640 1 -- 172.21.15.132:0/31022369 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c032440 con 0x7f1d540cc230 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.547+0000 7f1d527fc640 1 -- 172.21.15.132:0/31022369 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c032810 con 0x7f1d540cc230 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 -- 172.21.15.132:0/31022369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 msgr2=0x7f1d54072b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 --2- 172.21.15.132:0/31022369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54072b90 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c02a2a0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.553 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 -- 172.21.15.132:0/31022369 shutdown_connections 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 --2- 172.21.15.132:0/31022369 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54072b90 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 --2- 172.21.15.132:0/31022369 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540cb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 -- 172.21.15.132:0/31022369 >> 172.21.15.132:0/31022369 conn(0x7f1d54075d50 msgr2=0x7f1d5406ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 -- 172.21.15.132:0/31022369 shutdown_connections 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.548+0000 7f1d5939b640 1 -- 172.21.15.132:0/31022369 wait complete. 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 Processor -- start 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 -- start start 2024-04-25T12:50:59.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d540730d0 0x7f1d541e63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54156220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1d540ce2b0 con 0x7f1d540cc230 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1d540cb850 con 0x7f1d540730d0 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.549+0000 7f1d5939b640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1d5415f170 con 0x7f1d54155530 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54156220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54156220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54154/0 (socket says 172.21.15.132:54154) 2024-04-25T12:50:59.555 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 -- 172.21.15.132:0/2889378265 learned_addr learned my addr 172.21.15.132:0/2889378265 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d52ffd640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d540730d0 0x7f1d541e63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d537fe640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 -- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 msgr2=0x7f1d540c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 -- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d540730d0 msgr2=0x7f1d541e63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d540730d0 0x7f1d541e63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 -- 172.21.15.132:0/2889378265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d541e5610 con 0x7f1d540cc230 2024-04-25T12:50:59.556 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d537fe640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4bfff640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54156220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c041070 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c03c870 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d541e58f0 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c037040 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.550+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d54152c10 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.551+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d54146b70 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.552+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1d3c044070 con 0x7f1d540cc230 2024-04-25T12:50:59.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.552+0000 7f1d4b7fe640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d3406c8f0 0x7f1d3406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.552+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f1d3c0ac9b0 con 0x7f1d540cc230 2024-04-25T12:50:59.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.552+0000 7f1d52ffd640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d3406c8f0 0x7f1d3406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.553+0000 7f1d52ffd640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d3406c8f0 0x7f1d3406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400aa20 tx=0x7f1d44008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.557+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1d3c07a370 con 0x7f1d540cc230 2024-04-25T12:50:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.731+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f1d5415d350 con 0x7f1d3406c8f0 2024-04-25T12:50:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.732+0000 7f1d4b7fe640 1 -- 172.21.15.132:0/2889378265 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f1d5415d350 con 0x7f1d3406c8f0 2024-04-25T12:50:59.731 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T12:50:59.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d3406c8f0 msgr2=0x7f1d3406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d3406c8f0 0x7f1d3406edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400aa20 tx=0x7f1d44008040 comp rx=0 tx=0).stop 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 msgr2=0x7f1d54156220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54156220 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c009870 tx=0x7f1d3c0046c0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 shutdown_connections 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d3406c8f0 0x7f1d3406edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1d54155530 0x7f1d540c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d540cc230 0x7f1d54156220 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 --2- 172.21.15.132:0/2889378265 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1d540730d0 0x7f1d541e63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 >> 172.21.15.132:0/2889378265 conn(0x7f1d54075d50 msgr2=0x7f1d5415e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 shutdown_connections 2024-04-25T12:50:59.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.734+0000 7f1d5939b640 1 -- 172.21.15.132:0/2889378265 wait complete. 2024-04-25T12:50:59.744 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T12:50:59.744 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:50:59.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 Processor -- start 2024-04-25T12:50:59.846 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 -- start start 2024-04-25T12:50:59.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2401444b0 0x7fb2400c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2400c9520 0x7fb240067630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb24015bfe0 con 0x7fb240067b70 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fb24015e790 con 0x7fb2401444b0 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb247005640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb24015e9e0 con 0x7fb2400c9520 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb244da1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2401444b0 0x7fb2400c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.847+0000 7fb2455a2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb240067b70 0x7fb24015b200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56276/0 (socket says 172.21.15.132:56276) 2024-04-25T12:50:59.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb2455a2640 1 -- 172.21.15.132:0/1549817271 learned_addr learned my addr 172.21.15.132:0/1549817271 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb23ffff640 1 --2- 172.21.15.132:0/1549817271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2400c9520 0x7fb240067630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb244da1640 1 -- 172.21.15.132:0/1549817271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2400c9520 msgr2=0x7fb240067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb244da1640 1 --2- 172.21.15.132:0/1549817271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2400c9520 0x7fb240067630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb244da1640 1 -- 172.21.15.132:0/1549817271 >> v1:172.21.15.132:6789/0 conn(0x7fb240067b70 legacy=0x7fb24015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb244da1640 1 -- 172.21.15.132:0/1549817271 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24015ecc0 con 0x7fb2401444b0 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb23f7fe640 1 -- 172.21.15.132:0/1549817271 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3654524261 0 0) 0x7fb24015bfe0 con 0x7fb240067b70 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.848+0000 7fb244da1640 1 --2- 172.21.15.132:0/1549817271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2400c8fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097a0 tx=0x7fb23402a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3adcd748060469a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb23f7fe640 1 -- 172.21.15.132:0/1549817271 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234037070 con 0x7fb2401444b0 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb23f7fe640 1 -- 172.21.15.132:0/1549817271 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb234032440 con 0x7fb2401444b0 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb23f7fe640 1 -- 172.21.15.132:0/1549817271 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234032810 con 0x7fb2401444b0 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 -- 172.21.15.132:0/1549817271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 msgr2=0x7fb2400c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 --2- 172.21.15.132:0/1549817271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2400c8fe0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb2340097a0 tx=0x7fb23402a180 comp rx=0 tx=0).stop 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 -- 172.21.15.132:0/1549817271 shutdown_connections 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 --2- 172.21.15.132:0/1549817271 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb2400c9520 0x7fb240067630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 --2- 172.21.15.132:0/1549817271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2400c8fe0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 -- 172.21.15.132:0/1549817271 >> 172.21.15.132:0/1549817271 conn(0x7fb2400cd740 msgr2=0x7fb2400cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 -- 172.21.15.132:0/1549817271 shutdown_connections 2024-04-25T12:50:59.852 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.849+0000 7fb247005640 1 -- 172.21.15.132:0/1549817271 wait complete. 2024-04-25T12:50:59.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.850+0000 7fb247005640 1 Processor -- start 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.850+0000 7fb247005640 1 -- start start 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb247005640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb240067b70 0x7fb2400c7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb247005640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2400c9520 0x7fb2401e7a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb247005640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2401f4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb247005640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fb240144890 con 0x7fb2401444b0 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb247005640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fb24015f280 con 0x7fb2400c9520 2024-04-25T12:50:59.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb247005640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fb240068280 con 0x7fb240067b70 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb2455a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2401f4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb2455a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2401f4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54180/0 (socket says 172.21.15.132:54180) 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.851+0000 7fb2455a2640 1 -- 172.21.15.132:0/1806740073 learned_addr learned my addr 172.21.15.132:0/1806740073 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb23ffff640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2400c9520 0x7fb2401e7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb244da1640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb240067b70 0x7fb2400c7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb2455a2640 1 -- 172.21.15.132:0/1806740073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb240067b70 msgr2=0x7fb2400c7460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb2455a2640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fb240067b70 0x7fb2400c7460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb2455a2640 1 -- 172.21.15.132:0/1806740073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2400c9520 msgr2=0x7fb2401e7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb2455a2640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fb2400c9520 0x7fb2401e7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb2455a2640 1 -- 172.21.15.132:0/1806740073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2401f1190 con 0x7fb2401444b0 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb2455a2640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2401f4dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb23800c7b0 tx=0x7fb23800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb238018070 con 0x7fb2401444b0 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb23800a640 con 0x7fb2401444b0 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb240159070 con 0x7fb2401444b0 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23800aa30 con 0x7fb2401444b0 2024-04-25T12:50:59.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.852+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb240159310 con 0x7fb2401444b0 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.853+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2401f49a0 con 0x7fb2401444b0 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb23801b070 con 0x7fb2401444b0 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23d7fa640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb22406c920 0x7fb22406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fb23808bb10 con 0x7fb2401444b0 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb244da1640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb22406c920 0x7fb22406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23d7fa640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fb2240763b0 0x7fb224078850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 --> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb224078f20 con 0x7fb2240763b0 2024-04-25T12:50:59.859 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fb23808bfa0 con 0x7fb2401444b0 2024-04-25T12:50:59.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.854+0000 7fb23ffff640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fb2240763b0 0x7fb224078850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.855+0000 7fb244da1640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb22406c920 0x7fb22406ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb234034000 tx=0x7fb23402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.855+0000 7fb23ffff640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fb2240763b0 0x7fb224078850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.860 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.855+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== osd.1 v2:172.21.15.132:6800/2744549492 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb224078f20 con 0x7fb2240763b0 2024-04-25T12:50:59.867 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.868+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 --> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb2401f46b0 con 0x7fb2240763b0 2024-04-25T12:50:59.868 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb23d7fa640 1 -- 172.21.15.132:0/1806740073 <== osd.1 v2:172.21.15.132:6800/2744549492 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb2401f46b0 con 0x7fb2240763b0 2024-04-25T12:50:59.868 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:50:59.868 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:50:59.868 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:50:59.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fb2240763b0 msgr2=0x7fb224078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.869 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6800/2744549492,v1:172.21.15.132:6801/2744549492] conn(0x7fb2240763b0 0x7fb224078850 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb22406c920 msgr2=0x7fb22406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fb22406c920 0x7fb22406ede0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb234034000 tx=0x7fb23402e000 comp rx=0 tx=0).stop 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 msgr2=0x7fb2401f4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 --2- 172.21.15.132:0/1806740073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2401444b0 0x7fb2401f4dc0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fb23800c7b0 tx=0x7fb23800cc70 comp rx=0 tx=0).stop 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb2455a2640 1 -- 172.21.15.132:0/1806740073 reap_dead start 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 shutdown_connections 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 >> 172.21.15.132:0/1806740073 conn(0x7fb2400cd740 msgr2=0x7fb2400c9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 shutdown_connections 2024-04-25T12:50:59.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.869+0000 7fb247005640 1 -- 172.21.15.132:0/1806740073 wait complete. 2024-04-25T12:50:59.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T12:50:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.977+0000 7f648cb01640 1 Processor -- start 2024-04-25T12:50:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.977+0000 7f648cb01640 1 -- start start 2024-04-25T12:50:59.978 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f648cb01640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6488142710 0x7f64880c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f648cb01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488073ae0 0x7f64880c6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f648cb01640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64880c6ca0 con 0x7f648815c520 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f648cb01640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f64880c88b0 con 0x7f6488142710 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f648cb01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f64880c8b90 con 0x7f6488073ae0 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f648659c640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f6488142710 0x7f64880c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f6486d9d640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7f648815c520 0x7f64880c9560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:48658/0 (socket says 172.21.15.132:48658) 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f6485d9b640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488073ae0 0x7f64880c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.979 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.978+0000 7f6486d9d640 1 -- 172.21.15.132:0/3742045920 learned_addr learned my addr 172.21.15.132:0/3742045920 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f648559a640 1 -- 172.21.15.132:0/3742045920 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251364134 0 0) 0x7f6478001110 con 0x7f648815c520 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f648559a640 1 -- 172.21.15.132:0/3742045920 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6470003520 con 0x7f648815c520 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f6485d9b640 1 -- 172.21.15.132:0/3742045920 >> v2:172.21.15.157:3300/0 conn(0x7f6488142710 msgr2=0x7f64880c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f6485d9b640 1 --2- 172.21.15.132:0/3742045920 >> v2:172.21.15.157:3300/0 conn(0x7f6488142710 0x7f64880c81e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f6485d9b640 1 -- 172.21.15.132:0/3742045920 >> v1:172.21.15.157:6789/0 conn(0x7f648815c520 legacy=0x7f64880c9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f6485d9b640 1 -- 172.21.15.132:0/3742045920 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6488159280 con 0x7f6488073ae0 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.979+0000 7f6485d9b640 1 --2- 172.21.15.132:0/3742045920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488073ae0 0x7f64880c6760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f647c009d90 tx=0x7f647c02a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea040db4b83315da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648559a640 1 -- 172.21.15.132:0/3742045920 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c031600 con 0x7f6488073ae0 2024-04-25T12:50:59.980 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648559a640 1 -- 172.21.15.132:0/3742045920 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f647c0317a0 con 0x7f6488073ae0 2024-04-25T12:50:59.981 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648559a640 1 -- 172.21.15.132:0/3742045920 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f647c031b50 con 0x7f6488073ae0 2024-04-25T12:50:59.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 -- 172.21.15.132:0/3742045920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488073ae0 msgr2=0x7f64880c6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 --2- 172.21.15.132:0/3742045920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488073ae0 0x7f64880c6760 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f647c009d90 tx=0x7f647c02a5d0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 -- 172.21.15.132:0/3742045920 shutdown_connections 2024-04-25T12:50:59.984 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 --2- 172.21.15.132:0/3742045920 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488073ae0 0x7f64880c6760 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 --2- 172.21.15.132:0/3742045920 >> v2:172.21.15.157:3300/0 conn(0x7f6488142710 0x7f64880c81e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 -- 172.21.15.132:0/3742045920 >> 172.21.15.132:0/3742045920 conn(0x7f6488072e80 msgr2=0x7f6488073290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 -- 172.21.15.132:0/3742045920 shutdown_connections 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.980+0000 7f648cb01640 1 -- 172.21.15.132:0/3742045920 wait complete. 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.981+0000 7f648cb01640 1 Processor -- start 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.981+0000 7f648cb01640 1 -- start start 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6488073ae0 0x7f6488158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.985 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488142710 0x7f6488152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 0x7f6488152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6488158f30 con 0x7f648815c520 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6488159840 con 0x7f6488073ae0 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6488159d60 con 0x7f6488142710 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 0x7f6488152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 0x7f6488152670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54188/0 (socket says 172.21.15.132:54188) 2024-04-25T12:50:59.986 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 -- 172.21.15.132:0/59674799 learned_addr learned my addr 172.21.15.132:0/59674799 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648659c640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6488073ae0 0x7f6488158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6485d9b640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488142710 0x7f6488152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 -- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488142710 msgr2=0x7f6488152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488142710 0x7f6488152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 -- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6488073ae0 msgr2=0x7f6488158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6488073ae0 0x7f6488158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 -- 172.21.15.132:0/59674799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64880cb550 con 0x7f648815c520 2024-04-25T12:50:59.987 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6486d9d640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 0x7f6488152670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f647800c760 tx=0x7f647800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478017070 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64780058b0 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f648815ad00 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6478005ca0 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.983+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f648815b9c0 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.984+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f648815b7b0 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.984+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f647801a070 con 0x7f648815c520 2024-04-25T12:50:59.988 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.985+0000 7f6476ffd640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f646806c8f0 0x7f646806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:50:59.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.985+0000 7f648659c640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f646806c8f0 0x7f646806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:50:59.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.985+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f647808b260 con 0x7f648815c520 2024-04-25T12:50:59.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.985+0000 7f648659c640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f646806c8f0 0x7f646806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6480009b40 tx=0x7f6480009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:50:59.989 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:50:59.990+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f64880c6ca0 con 0x7f648815c520 2024-04-25T12:51:00.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.164+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f6488068d00 con 0x7f646806c8f0 2024-04-25T12:51:00.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.164+0000 7f6476ffd640 1 -- 172.21.15.132:0/59674799 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6488068d00 con 0x7f646806c8f0 2024-04-25T12:51:00.164 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T12:51:00.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.166+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f646806c8f0 msgr2=0x7f646806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.166+0000 7f648cb01640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f646806c8f0 0x7f646806edb0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f6480009b40 tx=0x7f6480009190 comp rx=0 tx=0).stop 2024-04-25T12:51:00.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.166+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 msgr2=0x7f6488152670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.166+0000 7f648cb01640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 0x7f6488152670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f647800c760 tx=0x7f647800cc20 comp rx=0 tx=0).stop 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 shutdown_connections 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f646806c8f0 0x7f646806edb0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f648815c520 0x7f6488152670 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6488142710 0x7f6488152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 --2- 172.21.15.132:0/59674799 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6488073ae0 0x7f6488158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 >> 172.21.15.132:0/59674799 conn(0x7f6488072e80 msgr2=0x7f64880c8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 shutdown_connections 2024-04-25T12:51:00.167 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.167+0000 7f648cb01640 1 -- 172.21.15.132:0/59674799 wait complete. 2024-04-25T12:51:00.177 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T12:51:00.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:51:00.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.279+0000 7f9a12279640 1 Processor -- start 2024-04-25T12:51:00.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.279+0000 7f9a12279640 1 -- start start 2024-04-25T12:51:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a12279640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a0c15bae0 0x7f9a0c151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a12279640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c0c8520 0x7f9a0c1521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a12279640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a0c0c8ad0 con 0x7f9a0c15b700 2024-04-25T12:51:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a12279640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f9a0c0c99c0 con 0x7f9a0c15bae0 2024-04-25T12:51:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a12279640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c0c8db0 con 0x7f9a0c0c8520 2024-04-25T12:51:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a0c15bae0 0x7f9a0c151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a0c15bae0 0x7f9a0c151ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54192/0 (socket says 172.21.15.132:54192) 2024-04-25T12:51:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 -- 172.21.15.132:0/3963324951 learned_addr learned my addr 172.21.15.132:0/3963324951 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a10816640 1 --2- 172.21.15.132:0/3963324951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c0c8520 0x7f9a0c1521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 -- 172.21.15.132:0/3963324951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c0c8520 msgr2=0x7f9a0c1521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 --2- 172.21.15.132:0/3963324951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c0c8520 0x7f9a0c1521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 -- 172.21.15.132:0/3963324951 >> v1:172.21.15.157:6789/0 conn(0x7f9a0c15b700 legacy=0x7f9a0c0c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.280+0000 7f9a0b7fe640 1 -- 172.21.15.132:0/3963324951 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c0c9090 con 0x7f9a0c15bae0 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a0b7fe640 1 --2- 172.21.15.132:0/3963324951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c15bae0 0x7f9a0c151ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000bb10 tx=0x7f9a0002c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c94ad9957d1206f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a0affd640 1 -- 172.21.15.132:0/3963324951 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a00035070 con 0x7f9a0c15bae0 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a0affd640 1 -- 172.21.15.132:0/3963324951 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a00031610 con 0x7f9a0c15bae0 2024-04-25T12:51:00.282 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a0affd640 1 -- 172.21.15.132:0/3963324951 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a000319e0 con 0x7f9a0c15bae0 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 -- 172.21.15.132:0/3963324951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c15bae0 msgr2=0x7f9a0c151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 --2- 172.21.15.132:0/3963324951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c15bae0 0x7f9a0c151ca0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9a0000bb10 tx=0x7f9a0002c9b0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 -- 172.21.15.132:0/3963324951 shutdown_connections 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 --2- 172.21.15.132:0/3963324951 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c0c8520 0x7f9a0c1521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 --2- 172.21.15.132:0/3963324951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c15bae0 0x7f9a0c151ca0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 -- 172.21.15.132:0/3963324951 >> 172.21.15.132:0/3963324951 conn(0x7f9a0c06d380 msgr2=0x7f9a0c067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 -- 172.21.15.132:0/3963324951 shutdown_connections 2024-04-25T12:51:00.283 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.281+0000 7f9a12279640 1 -- 172.21.15.132:0/3963324951 wait complete. 2024-04-25T12:51:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.282+0000 7f9a12279640 1 Processor -- start 2024-04-25T12:51:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 -- start start 2024-04-25T12:51:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c0c8520 0x7f9a0c1e13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a0c15b700 0x7f9a0c0cb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c15bae0 0x7f9a0c0cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c15c0d0 con 0x7f9a0c0c8520 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f9a0c0c9650 con 0x7f9a0c15b700 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a12279640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f9a0c15c250 con 0x7f9a0c15bae0 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c0c8520 0x7f9a0c1e13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c0c8520 0x7f9a0c1e13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54208/0 (socket says 172.21.15.132:54208) 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.283+0000 7f9a0bfff640 1 -- 172.21.15.132:0/3262299758 learned_addr learned my addr 172.21.15.132:0/3262299758 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a10816640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c15bae0 0x7f9a0c0cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0b7fe640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a0c15b700 0x7f9a0c0cb470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0bfff640 1 -- 172.21.15.132:0/3262299758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c15bae0 msgr2=0x7f9a0c0cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0bfff640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f9a0c15bae0 0x7f9a0c0cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0bfff640 1 -- 172.21.15.132:0/3262299758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a0c15b700 msgr2=0x7f9a0c0cb470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0bfff640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f9a0c15b700 0x7f9a0c0cb470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0bfff640 1 -- 172.21.15.132:0/3262299758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a0c073830 con 0x7f9a0c0c8520 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a0bfff640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c0c8520 0x7f9a0c1e13b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c400 tx=0x7f99fc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc0052d0 con 0x7f9a0c0c8520 2024-04-25T12:51:00.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99fc005490 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99fc007260 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a0c1408c0 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.284+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a0c0ca990 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.285+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9a0c068da0 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.285+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f99fc007400 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a08ff9640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f99f806c8f0 0x7f99f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f99fc08b4a0 con 0x7f9a0c0c8520 2024-04-25T12:51:00.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a0b7fe640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f99f806c8f0 0x7f99f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a08ff9640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f99f8076380 0x7f99f8078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 --> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99fc009e50 con 0x7f99f8076380 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f99fc092050 con 0x7f9a0c0c8520 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a10816640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f99f8076380 0x7f99f8078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.286+0000 7f9a0b7fe640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f99f806c8f0 0x7f99f806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a00037000 tx=0x7f9a0003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.287+0000 7f9a10816640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f99f8076380 0x7f99f8078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.287+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== osd.2 v2:172.21.15.132:6816/1070089983 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99fc009e50 con 0x7f99f8076380 2024-04-25T12:51:00.299 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.300+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 --> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f9a0c15b0e0 con 0x7f99f8076380 2024-04-25T12:51:00.300 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.300+0000 7f9a08ff9640 1 -- 172.21.15.132:0/3262299758 <== osd.2 v2:172.21.15.132:6816/1070089983 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f9a0c15b0e0 con 0x7f99f8076380 2024-04-25T12:51:00.300 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:51:00.300 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:51:00.300 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:51:00.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f99f8076380 msgr2=0x7f99f8078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.301 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6816/1070089983,v1:172.21.15.132:6817/1070089983] conn(0x7f99f8076380 0x7f99f8078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f99f806c8f0 msgr2=0x7f99f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f99f806c8f0 0x7f99f806edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9a00037000 tx=0x7f9a0003c040 comp rx=0 tx=0).stop 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c0c8520 msgr2=0x7f9a0c1e13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 --2- 172.21.15.132:0/3262299758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a0c0c8520 0x7f9a0c1e13b0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f99fc00c400 tx=0x7f99fc00c8c0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a10816640 1 -- 172.21.15.132:0/3262299758 reap_dead start 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 shutdown_connections 2024-04-25T12:51:00.302 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 >> 172.21.15.132:0/3262299758 conn(0x7f9a0c06d380 msgr2=0x7f9a0c06e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 shutdown_connections 2024-04-25T12:51:00.303 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.301+0000 7f9a12279640 1 -- 172.21.15.132:0/3262299758 wait complete. 2024-04-25T12:51:00.310 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T12:51:00.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.410+0000 7f3990ae1640 1 Processor -- start 2024-04-25T12:51:00.409 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.410+0000 7f3990ae1640 1 -- start start 2024-04-25T12:51:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f3990ae1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f398c155380 0x7f398c0c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f3990ae1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 0x7f398c0c67a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f3990ae1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f398c0cbef0 con 0x7f398c15e7c0 2024-04-25T12:51:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f3990ae1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f398c0d08a0 con 0x7f398c155380 2024-04-25T12:51:00.413 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f3990ae1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f398c0d0af0 con 0x7f398c0cdfe0 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f398c15e7c0 0x7f398c0cb2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56280/0 (socket says 172.21.15.132:56280) 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398ad9d640 1 -- 172.21.15.132:0/2681549847 learned_addr learned my addr 172.21.15.132:0/2681549847 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398a59c640 1 --2- 172.21.15.132:0/2681549847 >> v2:172.21.15.157:3300/0 conn(0x7f398c155380 0x7f398c0c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f3989d9b640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 0x7f398c0c67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4290176333 0 0) 0x7f398c0cbef0 con 0x7f398c15e7c0 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3974003520 con 0x7f398c15e7c0 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4208522593 0 0) 0x7f3974003520 con 0x7f398c15e7c0 2024-04-25T12:51:00.414 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 msgr2=0x7f398c0c67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 0x7f398c0c67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 >> v2:172.21.15.157:3300/0 conn(0x7f398c155380 msgr2=0x7f398c0c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 --2- 172.21.15.132:0/2681549847 >> v2:172.21.15.157:3300/0 conn(0x7f398c155380 0x7f398c0c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c0d0dd0 con 0x7f398c15e7c0 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398a59c640 1 --2- 172.21.15.132:0/2681549847 >> v2:172.21.15.157:3300/0 conn(0x7f398c155380 0x7f398c0c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f39840019f0 con 0x7f398c15e7c0 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 >> v1:172.21.15.132:6789/0 conn(0x7f398c15e7c0 legacy=0x7f398c0cb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 0x7f39740039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974003f30 0x7f3974004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3974004d40 0x7f39740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0d08a0 con 0x7f3974004d40 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f398c0d0af0 con 0x7f3974003f30 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.411+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f397400b9f0 con 0x7f398c0cdfe0 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398ad9d640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3974004d40 0x7f39740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398a59c640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 0x7f39740039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f3989d9b640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974003f30 0x7f3974004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398ad9d640 1 -- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 msgr2=0x7f39740039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.416 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398ad9d640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cdfe0 0x7f39740039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398ad9d640 1 -- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974003f30 msgr2=0x7f3974004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398ad9d640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974003f30 0x7f3974004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.412+0000 7f398ad9d640 1 -- 172.21.15.132:0/2681549847 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3974003520 con 0x7f3974004d40 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f398ad9d640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3974004d40 0x7f39740051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f398400a870 tx=0x7f3974005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c01d6b381661fbbd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398400a4c0 con 0x7f3974004d40 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398402f070 con 0x7f3974004d40 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f398959a640 1 -- 172.21.15.132:0/2681549847 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398402bcc0 con 0x7f3974004d40 2024-04-25T12:51:00.417 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f3990ae1640 1 -- 172.21.15.132:0/2681549847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3974004d40 msgr2=0x7f39740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2681549847 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3974004d40 0x7f39740051c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f398400a870 tx=0x7f3974005830 comp rx=0 tx=0).stop 2024-04-25T12:51:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f398ad9d640 1 -- 172.21.15.132:0/2681549847 reap_dead start 2024-04-25T12:51:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f3990ae1640 1 -- 172.21.15.132:0/2681549847 shutdown_connections 2024-04-25T12:51:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f3990ae1640 1 -- 172.21.15.132:0/2681549847 >> 172.21.15.132:0/2681549847 conn(0x7f398c06c030 msgr2=0x7f398c06c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f3990ae1640 1 -- 172.21.15.132:0/2681549847 shutdown_connections 2024-04-25T12:51:00.418 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.413+0000 7f3990ae1640 1 -- 172.21.15.132:0/2681549847 wait complete. 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 Processor -- start 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 -- start start 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974004d40 0x7f398c15b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 0x7f398c14f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cd010 0x7f398c14f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f398c1558e0 con 0x7f398c158910 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f398c155760 con 0x7f3974004d40 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3990ae1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f398c0cb9c0 con 0x7f398c0cd010 2024-04-25T12:51:00.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.415+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 0x7f398c14f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 0x7f398c14f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54222/0 (socket says 172.21.15.132:54222) 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 -- 172.21.15.132:0/2366646737 learned_addr learned my addr 172.21.15.132:0/2366646737 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f398a59c640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974004d40 0x7f398c15b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 -- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cd010 msgr2=0x7f398c14f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f398ad9d640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cd010 0x7f398c14f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cd010 0x7f398c14f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 -- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974004d40 msgr2=0x7f398c15b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974004d40 0x7f398c15b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.423 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 -- 172.21.15.132:0/2366646737 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f398c1e3c10 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3989d9b640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 0x7f398c14f2b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3980011910 tx=0x7f3980011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398000faf0 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398000fc90 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f398c1f15c0 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3980014440 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.416+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f398c1e4190 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.417+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f398c068d00 con 0x7f398c158910 2024-04-25T12:51:00.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.418+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3980012040 con 0x7f398c158910 2024-04-25T12:51:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.418+0000 7f397affd640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f396c06c920 0x7f396c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.418+0000 7f398a59c640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f396c06c920 0x7f396c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.418+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f398008c550 con 0x7f398c158910 2024-04-25T12:51:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.419+0000 7f398a59c640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f396c06c920 0x7f396c06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f398c073530 tx=0x7f397c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.423+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3980019030 con 0x7f398c158910 2024-04-25T12:51:00.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.597+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f398c158e20 con 0x7f396c06c920 2024-04-25T12:51:00.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.598+0000 7f397affd640 1 -- 172.21.15.132:0/2366646737 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f398c158e20 con 0x7f396c06c920 2024-04-25T12:51:00.597 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T12:51:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f396c06c920 msgr2=0x7f396c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f396c06c920 0x7f396c06ede0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f398c073530 tx=0x7f397c008040 comp rx=0 tx=0).stop 2024-04-25T12:51:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 msgr2=0x7f398c14f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 0x7f398c14f2b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f3980011910 tx=0x7f3980011dd0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 shutdown_connections 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f396c06c920 0x7f396c06ede0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f398c0cd010 0x7f398c14f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f398c158910 0x7f398c14f2b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 --2- 172.21.15.132:0/2366646737 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3974004d40 0x7f398c15b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 >> 172.21.15.132:0/2366646737 conn(0x7f398c06c030 msgr2=0x7f398c0cc1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 shutdown_connections 2024-04-25T12:51:00.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.601+0000 7f3990ae1640 1 -- 172.21.15.132:0/2366646737 wait complete. 2024-04-25T12:51:00.611 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T12:51:00.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:51:00.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.713+0000 7f04f6b87640 1 Processor -- start 2024-04-25T12:51:00.713 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.713+0000 7f04f6b87640 1 -- start start 2024-04-25T12:51:00.715 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f6b87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f6b87640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f04f0158570 0x7f04f006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f6b87640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04f0158a20 0x7f04f006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f6b87640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f04f00c98a0 con 0x7f04f0158a20 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f6b87640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f04f00c89b0 con 0x7f04f0158570 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f6b87640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f04f00c8c90 con 0x7f04f0158190 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f5124640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04f0158a20 0x7f04f006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f5124640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04f0158a20 0x7f04f006e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54226/0 (socket says 172.21.15.132:54226) 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f5124640 1 -- 172.21.15.132:0/3849916194 learned_addr learned my addr 172.21.15.132:0/3849916194 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:00.716 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04effff640 1 --2- 172.21.15.132:0/3849916194 >> v2:172.21.15.157:3300/0 conn(0x7f04f0158570 0x7f04f006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.714+0000 7f04f4923640 1 --2- 172.21.15.132:0/3849916194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04f5124640 1 -- 172.21.15.132:0/3849916194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 msgr2=0x7f04f00cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04f5124640 1 --2- 172.21.15.132:0/3849916194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04f5124640 1 -- 172.21.15.132:0/3849916194 >> v2:172.21.15.157:3300/0 conn(0x7f04f0158570 msgr2=0x7f04f006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04f5124640 1 --2- 172.21.15.132:0/3849916194 >> v2:172.21.15.157:3300/0 conn(0x7f04f0158570 0x7f04f006e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04f5124640 1 -- 172.21.15.132:0/3849916194 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f00c8f70 con 0x7f04f0158a20 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04f5124640 1 --2- 172.21.15.132:0/3849916194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158a20 0x7f04f006e880 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04f00c8ea0 tx=0x7f04e802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76d8ab59ba52582b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04ef7fe640 1 -- 172.21.15.132:0/3849916194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e8036070 con 0x7f04f0158a20 2024-04-25T12:51:00.717 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04ef7fe640 1 -- 172.21.15.132:0/3849916194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e8031600 con 0x7f04f0158a20 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.715+0000 7f04ef7fe640 1 -- 172.21.15.132:0/3849916194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e80319d0 con 0x7f04f0158a20 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 -- 172.21.15.132:0/3849916194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158a20 msgr2=0x7f04f006e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 --2- 172.21.15.132:0/3849916194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158a20 0x7f04f006e880 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f04f00c8ea0 tx=0x7f04e802a680 comp rx=0 tx=0).stop 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 -- 172.21.15.132:0/3849916194 shutdown_connections 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 --2- 172.21.15.132:0/3849916194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158a20 0x7f04f006e880 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 --2- 172.21.15.132:0/3849916194 >> v2:172.21.15.157:3300/0 conn(0x7f04f0158570 0x7f04f006e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 --2- 172.21.15.132:0/3849916194 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 -- 172.21.15.132:0/3849916194 >> 172.21.15.132:0/3849916194 conn(0x7f04f00ca340 msgr2=0x7f04f00ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 -- 172.21.15.132:0/3849916194 shutdown_connections 2024-04-25T12:51:00.719 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.716+0000 7f04f6b87640 1 -- 172.21.15.132:0/3849916194 wait complete. 2024-04-25T12:51:00.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.717+0000 7f04f6b87640 1 Processor -- start 2024-04-25T12:51:00.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.717+0000 7f04f6b87640 1 -- start start 2024-04-25T12:51:00.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f6b87640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00678a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f6b87640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158570 0x7f04f01dec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f6b87640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0158a20 0x7f04f01df150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f6b87640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f04f00c9d30 con 0x7f04f0158570 2024-04-25T12:51:00.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f6b87640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f04f00c9530 con 0x7f04f0158a20 2024-04-25T12:51:00.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f6b87640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f04f0068550 con 0x7f04f0158190 2024-04-25T12:51:00.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158570 0x7f04f01dec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158570 0x7f04f01dec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54234/0 (socket says 172.21.15.132:54234) 2024-04-25T12:51:00.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 -- 172.21.15.132:0/4132682145 learned_addr learned my addr 172.21.15.132:0/4132682145 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:00.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f5124640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0158a20 0x7f04f01df150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04f4923640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00678a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.724 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 -- 172.21.15.132:0/4132682145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 msgr2=0x7f04f00678a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f04f0158190 0x7f04f00678a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 -- 172.21.15.132:0/4132682145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0158a20 msgr2=0x7f04f01df150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f04f0158a20 0x7f04f01df150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.718+0000 7f04effff640 1 -- 172.21.15.132:0/4132682145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f01eee30 con 0x7f04f0158570 2024-04-25T12:51:00.725 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.719+0000 7f04effff640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158570 0x7f04f01dec10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f04e400d800 tx=0x7f04e400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.719+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400b660 con 0x7f04f0158570 2024-04-25T12:51:00.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.719+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e4019070 con 0x7f04f0158570 2024-04-25T12:51:00.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.719+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e400ba20 con 0x7f04f0158570 2024-04-25T12:51:00.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.719+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f01ef110 con 0x7f04f0158570 2024-04-25T12:51:00.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.719+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f01ef6d0 con 0x7f04f0158570 2024-04-25T12:51:00.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.720+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f04f0068da0 con 0x7f04f0158570 2024-04-25T12:51:00.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.720+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04e400bbc0 con 0x7f04f0158570 2024-04-25T12:51:00.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04ed7fa640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f04dc06c8f0 0x7f04dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f04e408c200 con 0x7f04f0158570 2024-04-25T12:51:00.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04f4923640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f04dc06c8f0 0x7f04dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04ed7fa640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7f04dc076380 0x7f04dc078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 --> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f04e4001d30 con 0x7f04dc076380 2024-04-25T12:51:00.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f04e4093050 con 0x7f04f0158570 2024-04-25T12:51:00.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04f5124640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7f04dc076380 0x7f04dc078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04f4923640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f04dc06c8f0 0x7f04dc06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04e0006fd0 tx=0x7f04e0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.721+0000 7f04f5124640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7f04dc076380 0x7f04dc078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.722+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== osd.3 v2:172.21.15.132:6824/4017369703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f04e4001d30 con 0x7f04dc076380 2024-04-25T12:51:00.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 --> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f04f006f5e0 con 0x7f04dc076380 2024-04-25T12:51:00.734 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04ed7fa640 1 -- 172.21.15.132:0/4132682145 <== osd.3 v2:172.21.15.132:6824/4017369703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f04f006f5e0 con 0x7f04dc076380 2024-04-25T12:51:00.734 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:51:00.735 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:51:00.735 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:51:00.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7f04dc076380 msgr2=0x7f04dc078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6824/4017369703,v1:172.21.15.132:6825/4017369703] conn(0x7f04dc076380 0x7f04dc078820 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f04dc06c8f0 msgr2=0x7f04dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f04dc06c8f0 0x7f04dc06edb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f04e0006fd0 tx=0x7f04e0008040 comp rx=0 tx=0).stop 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158570 msgr2=0x7f04f01dec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 --2- 172.21.15.132:0/4132682145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04f0158570 0x7f04f01dec10 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f04e400d800 tx=0x7f04e400dcc0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f5124640 1 -- 172.21.15.132:0/4132682145 reap_dead start 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 shutdown_connections 2024-04-25T12:51:00.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 >> 172.21.15.132:0/4132682145 conn(0x7f04f00ca340 msgr2=0x7f04f00ca720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 shutdown_connections 2024-04-25T12:51:00.737 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.735+0000 7f04f6b87640 1 -- 172.21.15.132:0/4132682145 wait complete. 2024-04-25T12:51:00.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T12:51:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 Processor -- start 2024-04-25T12:51:00.845 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 -- start start 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc858152010 0x7fc858158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8580c5fd0 0x7fc8580c6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8580c6980 con 0x7fc8580c8670 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fc8580c5b40 con 0x7fc8580c5fd0 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.847+0000 7fc85e937640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580c56f0 con 0x7fc858152010 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc85ced4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8580c5fd0 0x7fc8580c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.848 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc8577fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc8580c8670 0x7fc8580cc4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56284/0 (socket says 172.21.15.132:56284) 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc85ced4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8580c5fd0 0x7fc8580c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54242/0 (socket says 172.21.15.132:54242) 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc8577fe640 1 -- 172.21.15.132:0/3812299730 learned_addr learned my addr 172.21.15.132:0/3812299730 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc857fff640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc858152010 0x7fc858158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc85ced4640 1 -- 172.21.15.132:0/3812299730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc858152010 msgr2=0x7fc858158880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc85ced4640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc858152010 0x7fc858158880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc85ced4640 1 -- 172.21.15.132:0/3812299730 >> v1:172.21.15.132:6789/0 conn(0x7fc8580c8670 legacy=0x7fc8580cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc85ced4640 1 -- 172.21.15.132:0/3812299730 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580c4b70 con 0x7fc8580c5fd0 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc856ffd640 1 -- 172.21.15.132:0/3812299730 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466671212 0 0) 0x7fc8580c6980 con 0x7fc8580c8670 2024-04-25T12:51:00.849 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.848+0000 7fc857fff640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc858152010 0x7fc858158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85ced4640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c5fd0 0x7fc8580c6440 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc850009d90 tx=0x7fc85002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=602467d66ba9ef2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc856ffd640 1 -- 172.21.15.132:0/3812299730 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850007740 con 0x7fc8580c5fd0 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc856ffd640 1 -- 172.21.15.132:0/3812299730 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8500078e0 con 0x7fc8580c5fd0 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc856ffd640 1 -- 172.21.15.132:0/3812299730 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc850007cb0 con 0x7fc8580c5fd0 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 -- 172.21.15.132:0/3812299730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c5fd0 msgr2=0x7fc8580c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c5fd0 0x7fc8580c6440 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc850009d90 tx=0x7fc85002a660 comp rx=0 tx=0).stop 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 -- 172.21.15.132:0/3812299730 shutdown_connections 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c5fd0 0x7fc8580c6440 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.850 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 --2- 172.21.15.132:0/3812299730 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc858152010 0x7fc858158880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 -- 172.21.15.132:0/3812299730 >> 172.21.15.132:0/3812299730 conn(0x7fc858075db0 msgr2=0x7fc858067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:00.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 -- 172.21.15.132:0/3812299730 shutdown_connections 2024-04-25T12:51:00.851 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.849+0000 7fc85e937640 1 -- 172.21.15.132:0/3812299730 wait complete. 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.850+0000 7fc85e937640 1 Processor -- start 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 -- start start 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8580c5fd0 0x7fc8581e34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 0x7fc8581483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc858152010 0x7fc8581f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580c5410 con 0x7fc8580c8670 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fc8580c5130 con 0x7fc858152010 2024-04-25T12:51:00.854 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc85e937640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fc8580c3ae0 con 0x7fc8580c5fd0 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc8577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 0x7fc8581483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc8577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 0x7fc8581483c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54256/0 (socket says 172.21.15.132:54256) 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.851+0000 7fc8577fe640 1 -- 172.21.15.132:0/2594567567 learned_addr learned my addr 172.21.15.132:0/2594567567 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc857fff640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8580c5fd0 0x7fc8581e34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc85ced4640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc858152010 0x7fc8581f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc8577fe640 1 -- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8580c5fd0 msgr2=0x7fc8581e34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc8577fe640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8580c5fd0 0x7fc8581e34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc8577fe640 1 -- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc858152010 msgr2=0x7fc8581f26f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:00.855 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc8577fe640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc858152010 0x7fc8581f26f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc8577fe640 1 -- 172.21.15.132:0/2594567567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8580c3580 con 0x7fc8580c8670 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc857fff640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8580c5fd0 0x7fc8581e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc8577fe640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 0x7fc8581483c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c500 tx=0x7fc84c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c018070 con 0x7fc8580c8670 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc84c007580 con 0x7fc8580c8670 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc84c004a20 con 0x7fc8580c8670 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc85815b9c0 con 0x7fc8580c8670 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.852+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8581f2c30 con 0x7fc8580c8670 2024-04-25T12:51:00.856 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.853+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc858068d00 con 0x7fc8580c8670 2024-04-25T12:51:00.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.853+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc84c01b070 con 0x7fc8580c8670 2024-04-25T12:51:00.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.854+0000 7fc854ff9640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc84406c8f0 0x7fc84406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:00.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.854+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fc84c08b240 con 0x7fc8580c8670 2024-04-25T12:51:00.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.854+0000 7fc857fff640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc84406c8f0 0x7fc84406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:00.857 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.854+0000 7fc857fff640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc84406c8f0 0x7fc84406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc848006fd0 tx=0x7fc848008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:00.858 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:00.858+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc84c0592e0 con 0x7fc8580c8670 2024-04-25T12:51:01.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.032+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fc8580c8d30 con 0x7fc84406c8f0 2024-04-25T12:51:01.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.033+0000 7fc854ff9640 1 -- 172.21.15.132:0/2594567567 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fc8580c8d30 con 0x7fc84406c8f0 2024-04-25T12:51:01.031 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc84406c8f0 msgr2=0x7fc84406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc84406c8f0 0x7fc84406edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fc848006fd0 tx=0x7fc848008040 comp rx=0 tx=0).stop 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 msgr2=0x7fc8581483c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 0x7fc8581483c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00c500 tx=0x7fc84c00c9c0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 shutdown_connections 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fc84406c8f0 0x7fc84406edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fc858152010 0x7fc8581f26f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8580c8670 0x7fc8581483c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 --2- 172.21.15.132:0/2594567567 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fc8580c5fd0 0x7fc8581e34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 >> 172.21.15.132:0/2594567567 conn(0x7fc858075db0 msgr2=0x7fc85814c810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 shutdown_connections 2024-04-25T12:51:01.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.035+0000 7fc85e937640 1 -- 172.21.15.132:0/2594567567 wait complete. 2024-04-25T12:51:01.044 INFO:tasks.ceph:Scrubbing osd.4 2024-04-25T12:51:01.045 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:51:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.148+0000 7ffb264e1640 1 Processor -- start 2024-04-25T12:51:01.147 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.148+0000 7ffb264e1640 1 -- start start 2024-04-25T12:51:01.149 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb264e1640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7ffb20158190 0x7ffb200cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb264e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb2006e340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb264e1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb20158a20 0x7ffb2006e880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb264e1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7ffb200c98a0 con 0x7ffb20158a20 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb264e1640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7ffb200c89b0 con 0x7ffb20158190 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb264e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ffb200c8c90 con 0x7ffb20158570 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb24a7e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb20158a20 0x7ffb2006e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb24a7e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb20158a20 0x7ffb2006e880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54272/0 (socket says 172.21.15.132:54272) 2024-04-25T12:51:01.150 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb24a7e640 1 -- 172.21.15.132:0/3450752504 learned_addr learned my addr 172.21.15.132:0/3450752504 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb1f7fe640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb2006e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb1ffff640 1 --2- 172.21.15.132:0/3450752504 >> v2:172.21.15.157:3300/0 conn(0x7ffb20158190 0x7ffb200cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.151 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb24a7e640 1 -- 172.21.15.132:0/3450752504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 msgr2=0x7ffb2006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:01.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb2006e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.149+0000 7ffb24a7e640 1 -- 172.21.15.132:0/3450752504 >> v2:172.21.15.157:3300/0 conn(0x7ffb20158190 msgr2=0x7ffb200cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3450752504 >> v2:172.21.15.157:3300/0 conn(0x7ffb20158190 0x7ffb200cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb24a7e640 1 -- 172.21.15.132:0/3450752504 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb200c8f70 con 0x7ffb20158a20 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb1f7fe640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb2006e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb1ffff640 1 --2- 172.21.15.132:0/3450752504 >> v2:172.21.15.157:3300/0 conn(0x7ffb20158190 0x7ffb200cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158a20 0x7ffb2006e880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffb200c8ea0 tx=0x7ffb1802a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=784266e7bddc3aaa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb1effd640 1 -- 172.21.15.132:0/3450752504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb18036070 con 0x7ffb20158a20 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb1effd640 1 -- 172.21.15.132:0/3450752504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb18031600 con 0x7ffb20158a20 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.150+0000 7ffb1effd640 1 -- 172.21.15.132:0/3450752504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb180319d0 con 0x7ffb20158a20 2024-04-25T12:51:01.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 -- 172.21.15.132:0/3450752504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158a20 msgr2=0x7ffb2006e880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158a20 0x7ffb2006e880 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7ffb200c8ea0 tx=0x7ffb1802a680 comp rx=0 tx=0).stop 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 -- 172.21.15.132:0/3450752504 shutdown_connections 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158a20 0x7ffb2006e880 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3450752504 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb2006e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3450752504 >> v2:172.21.15.157:3300/0 conn(0x7ffb20158190 0x7ffb200cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 -- 172.21.15.132:0/3450752504 >> 172.21.15.132:0/3450752504 conn(0x7ffb200ca340 msgr2=0x7ffb200ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 -- 172.21.15.132:0/3450752504 shutdown_connections 2024-04-25T12:51:01.155 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.151+0000 7ffb264e1640 1 -- 172.21.15.132:0/3450752504 wait complete. 2024-04-25T12:51:01.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.152+0000 7ffb264e1640 1 Processor -- start 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.152+0000 7ffb264e1640 1 -- start start 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb264e1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158190 0x7ffb201eebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb264e1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb20147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb264e1640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb20158a20 0x7ffb200cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb264e1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200c9d30 con 0x7ffb20158190 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb264e1640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200c9530 con 0x7ffb20158a20 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb264e1640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7ffb201f2cf0 con 0x7ffb20158570 2024-04-25T12:51:01.159 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158190 0x7ffb201eebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158190 0x7ffb201eebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54288/0 (socket says 172.21.15.132:54288) 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 -- 172.21.15.132:0/3292036215 learned_addr learned my addr 172.21.15.132:0/3292036215 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb20158a20 0x7ffb200cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1f7fe640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb20147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 -- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 msgr2=0x7ffb20147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7ffb20158570 0x7ffb20147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 -- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb20158a20 msgr2=0x7ffb200cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb20158a20 0x7ffb200cc720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.160 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb1ffff640 1 -- 172.21.15.132:0/3292036215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb20154ea0 con 0x7ffb20158190 2024-04-25T12:51:01.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.153+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7ffb20158a20 0x7ffb200cc720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:01.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb1ffff640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158190 0x7ffb201eebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e810 tx=0x7ffb1000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1000f040 con 0x7ffb20158190 2024-04-25T12:51:01.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb10004030 con 0x7ffb20158190 2024-04-25T12:51:01.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb201ef570 con 0x7ffb20158190 2024-04-25T12:51:01.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10004400 con 0x7ffb20158190 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb201f2760 con 0x7ffb20158190 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.154+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffb20068da0 con 0x7ffb20158190 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.155+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb1000c6d0 con 0x7ffb20158190 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.155+0000 7ffb1cff9640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ffb0c06c8f0 0x7ffb0c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb1f7fe640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ffb0c06c8f0 0x7ffb0c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7ffb1008bc10 con 0x7ffb20158190 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb1cff9640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7ffb0c076390 0x7ffb0c078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 --> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffb0c078f00 con 0x7ffb0c076390 2024-04-25T12:51:01.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7ffb1008e310 con 0x7ffb20158190 2024-04-25T12:51:01.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7ffb0c076390 0x7ffb0c078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb1f7fe640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ffb0c06c8f0 0x7ffb0c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb200c7240 tx=0x7ffb14008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.156+0000 7ffb24a7e640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7ffb0c076390 0x7ffb0c078830 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.157+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== osd.4 v2:172.21.15.157:6824/361858762 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffb0c078f00 con 0x7ffb0c076390 2024-04-25T12:51:01.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.170+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 --> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffb200cd1f0 con 0x7ffb0c076390 2024-04-25T12:51:01.168 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.170+0000 7ffb1cff9640 1 -- 172.21.15.132:0/3292036215 <== osd.4 v2:172.21.15.157:6824/361858762 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffb200cd1f0 con 0x7ffb0c076390 2024-04-25T12:51:01.169 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:51:01.169 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:51:01.169 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:51:01.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7ffb0c076390 msgr2=0x7ffb0c078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.157:6824/361858762,v1:172.21.15.157:6825/361858762] conn(0x7ffb0c076390 0x7ffb0c078830 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ffb0c06c8f0 msgr2=0x7ffb0c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7ffb0c06c8f0 0x7ffb0c06edb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ffb200c7240 tx=0x7ffb14008040 comp rx=0 tx=0).stop 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158190 msgr2=0x7ffb201eebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 --2- 172.21.15.132:0/3292036215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb20158190 0x7ffb201eebf0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000e810 tx=0x7ffb1000ecd0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb24a7e640 1 -- 172.21.15.132:0/3292036215 reap_dead start 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 shutdown_connections 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 >> 172.21.15.132:0/3292036215 conn(0x7ffb200ca340 msgr2=0x7ffb200c4380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 shutdown_connections 2024-04-25T12:51:01.172 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.171+0000 7ffb264e1640 1 -- 172.21.15.132:0/3292036215 wait complete. 2024-04-25T12:51:01.180 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-25T12:51:01.277 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.279+0000 7f6f64f7d640 1 Processor -- start 2024-04-25T12:51:01.278 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.279+0000 7f6f64f7d640 1 -- start start 2024-04-25T12:51:01.279 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f64f7d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f60152010 0x7f6f60158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f64f7d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600c8670 0x7f6f600cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f64f7d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f600c56f0 con 0x7f6f600cca20 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f64f7d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f6f600c5b40 con 0x7f6f60152010 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f64f7d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6f600c4b70 con 0x7f6f600c8670 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f5e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6f60152010 0x7f6f60158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f5ed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6f600cca20 0x7f6f600c5fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56300/0 (socket says 172.21.15.132:56300) 2024-04-25T12:51:01.280 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.280+0000 7f6f5ed9d640 1 -- 172.21.15.132:0/1755929279 learned_addr learned my addr 172.21.15.132:0/1755929279 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5e59c640 1 -- 172.21.15.132:0/1755929279 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600c8670 msgr2=0x7f6f600cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5e59c640 1 --2- 172.21.15.132:0/1755929279 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600c8670 0x7f6f600cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5e59c640 1 -- 172.21.15.132:0/1755929279 >> v1:172.21.15.132:6789/0 conn(0x7f6f600cca20 legacy=0x7f6f600c5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5e59c640 1 -- 172.21.15.132:0/1755929279 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f600c4e50 con 0x7f6f60152010 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5d59a640 1 -- 172.21.15.132:0/1755929279 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3813040499 0 0) 0x7f6f600c56f0 con 0x7f6f600cca20 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5e59c640 1 --2- 172.21.15.132:0/1755929279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f60152010 0x7f6f60158880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009d90 tx=0x7f6f5002a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c682f03ce2cbc319 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5d59a640 1 -- 172.21.15.132:0/1755929279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007740 con 0x7f6f60152010 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5d59a640 1 -- 172.21.15.132:0/1755929279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f500078e0 con 0x7f6f60152010 2024-04-25T12:51:01.281 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.281+0000 7f6f5d59a640 1 -- 172.21.15.132:0/1755929279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50007cb0 con 0x7f6f60152010 2024-04-25T12:51:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 -- 172.21.15.132:0/1755929279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f60152010 msgr2=0x7f6f60158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/1755929279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f60152010 0x7f6f60158880 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009d90 tx=0x7f6f5002a660 comp rx=0 tx=0).stop 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 -- 172.21.15.132:0/1755929279 shutdown_connections 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/1755929279 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600c8670 0x7f6f600cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/1755929279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f60152010 0x7f6f60158880 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 -- 172.21.15.132:0/1755929279 >> 172.21.15.132:0/1755929279 conn(0x7f6f60075db0 msgr2=0x7f6f60067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 -- 172.21.15.132:0/1755929279 shutdown_connections 2024-04-25T12:51:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.282+0000 7f6f64f7d640 1 -- 172.21.15.132:0/1755929279 wait complete. 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.283+0000 7f6f64f7d640 1 Processor -- start 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.283+0000 7f6f64f7d640 1 -- start start 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f64f7d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 0x7f6f601eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f64f7d640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600cca20 0x7f6f6014dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f64f7d640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f60152010 0x7f6f6014ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f64f7d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600c3ae0 con 0x7f6f600c8670 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f64f7d640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f6f600c5410 con 0x7f6f60152010 2024-04-25T12:51:01.287 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f64f7d640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f6f600c4830 con 0x7f6f600cca20 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 0x7f6f601eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 0x7f6f601eeaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54302/0 (socket says 172.21.15.132:54302) 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 -- 172.21.15.132:0/2216230800 learned_addr learned my addr 172.21.15.132:0/2216230800 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5ed9d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f60152010 0x7f6f6014ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 -- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600cca20 msgr2=0x7f6f6014dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5dd9b640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600cca20 0x7f6f6014dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600cca20 0x7f6f6014dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 -- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f60152010 msgr2=0x7f6f6014ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.288 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.284+0000 7f6f5e59c640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f60152010 0x7f6f6014ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f5e59c640 1 -- 172.21.15.132:0/2216230800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f601eefe0 con 0x7f6f600c8670 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f5ed9d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f60152010 0x7f6f6014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f5dd9b640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600cca20 0x7f6f6014dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f5e59c640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 0x7f6f601eeaa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009d90 tx=0x7f6f50004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50040070 con 0x7f6f600c8670 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f50031d00 con 0x7f6f600c8670 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f60159750 con 0x7f6f600c8670 2024-04-25T12:51:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f50045680 con 0x7f6f600c8670 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.285+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f60150510 con 0x7f6f600c8670 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.286+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f60068d00 con 0x7f6f600c8670 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.286+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f50039040 con 0x7f6f600c8670 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.287+0000 7f6f4effd640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6f4006c8f0 0x7f6f4006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.287+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f6f500ad950 con 0x7f6f600c8670 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.287+0000 7f6f5dd9b640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6f4006c8f0 0x7f6f4006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.287+0000 7f6f5dd9b640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6f4006c8f0 0x7f6f4006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f54006fd0 tx=0x7f6f54008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.291+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f5007b960 con 0x7f6f600c8670 2024-04-25T12:51:01.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.471+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f6f600c8d30 con 0x7f6f4006c8f0 2024-04-25T12:51:01.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.471+0000 7f6f4effd640 1 -- 172.21.15.132:0/2216230800 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6f600c8d30 con 0x7f6f4006c8f0 2024-04-25T12:51:01.470 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 4 to deep-scrub 2024-04-25T12:51:01.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6f4006c8f0 msgr2=0x7f6f4006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.474 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6f4006c8f0 0x7f6f4006edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f6f54006fd0 tx=0x7f6f54008040 comp rx=0 tx=0).stop 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 msgr2=0x7f6f601eeaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 0x7f6f601eeaa0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f6f50009d90 tx=0x7f6f50004a40 comp rx=0 tx=0).stop 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 shutdown_connections 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f6f4006c8f0 0x7f6f4006edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f6f60152010 0x7f6f6014ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f6f600cca20 0x7f6f6014dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.475 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 --2- 172.21.15.132:0/2216230800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f600c8670 0x7f6f601eeaa0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 >> 172.21.15.132:0/2216230800 conn(0x7f6f60075db0 msgr2=0x7f6f60158810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 shutdown_connections 2024-04-25T12:51:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.473+0000 7f6f64f7d640 1 -- 172.21.15.132:0/2216230800 wait complete. 2024-04-25T12:51:01.482 INFO:tasks.ceph:Scrubbing osd.5 2024-04-25T12:51:01.483 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:51:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.587+0000 7f1dbc307640 1 Processor -- start 2024-04-25T12:51:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.587+0000 7f1dbc307640 1 -- start start 2024-04-25T12:51:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dbc307640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f1db415bae0 0x7f1db4151ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dbc307640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db40c8520 0x7f1db41521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dbc307640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1db40c8ad0 con 0x7f1db415b700 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dbc307640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f1db40c99c0 con 0x7f1db415bae0 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dbc307640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1db40c8db0 con 0x7f1db40c8520 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dba0a3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1db415b700 0x7f1db40c7a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56316/0 (socket says 172.21.15.132:56316) 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dba0a3640 1 -- 172.21.15.132:0/472672950 learned_addr learned my addr 172.21.15.132:0/472672950 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db98a2640 1 --2- 172.21.15.132:0/472672950 >> v2:172.21.15.157:3300/0 conn(0x7f1db415bae0 0x7f1db4151ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dba8a4640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db40c8520 0x7f1db41521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db90a1640 1 -- 172.21.15.132:0/472672950 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811222037 0 0) 0x7f1db40c8ad0 con 0x7f1db415b700 2024-04-25T12:51:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db90a1640 1 -- 172.21.15.132:0/472672950 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1da0003520 con 0x7f1db415b700 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db90a1640 1 -- 172.21.15.132:0/472672950 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 530585492 0 0) 0x7f1da0003520 con 0x7f1db415b700 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db98a2640 1 -- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db40c8520 msgr2=0x7f1db41521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db98a2640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db40c8520 0x7f1db41521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db98a2640 1 -- 172.21.15.132:0/472672950 >> v1:172.21.15.132:6789/0 conn(0x7f1db415b700 legacy=0x7f1db40c7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1db98a2640 1 -- 172.21.15.132:0/472672950 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db40c9090 con 0x7f1db415bae0 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.588+0000 7f1dba8a4640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db40c8520 0x7f1db41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.589+0000 7f1db98a2640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db415bae0 0x7f1db4151ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1da40097a0 tx=0x7f1da402a1a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75700111c2ee45e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.589+0000 7f1db90a1640 1 -- 172.21.15.132:0/472672950 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4037070 con 0x7f1db415bae0 2024-04-25T12:51:01.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.589+0000 7f1db90a1640 1 -- 172.21.15.132:0/472672950 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da402ac30 con 0x7f1db415bae0 2024-04-25T12:51:01.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.589+0000 7f1db90a1640 1 -- 172.21.15.132:0/472672950 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db0001670 con 0x7f1db415bae0 2024-04-25T12:51:01.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 -- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db415bae0 msgr2=0x7f1db4151ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db415bae0 0x7f1db4151ca0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1da40097a0 tx=0x7f1da402a1a0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 -- 172.21.15.132:0/472672950 shutdown_connections 2024-04-25T12:51:01.591 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db40c8520 0x7f1db41521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 --2- 172.21.15.132:0/472672950 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db415bae0 0x7f1db4151ca0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 -- 172.21.15.132:0/472672950 >> 172.21.15.132:0/472672950 conn(0x7f1db406d380 msgr2=0x7f1db4067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 -- 172.21.15.132:0/472672950 shutdown_connections 2024-04-25T12:51:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.590+0000 7f1dbc307640 1 -- 172.21.15.132:0/472672950 wait complete. 2024-04-25T12:51:01.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.591+0000 7f1dbc307640 1 Processor -- start 2024-04-25T12:51:01.595 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.591+0000 7f1dbc307640 1 -- start start 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db40c8520 0x7f1db41f4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db415b700 0x7f1db4153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db415bae0 0x7f1db4155d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f1db415c0d0 con 0x7f1db415b700 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f1db40c9650 con 0x7f1db40c8520 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f1db415c250 con 0x7f1db415bae0 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db415b700 0x7f1db4153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db415b700 0x7f1db4153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54318/0 (socket says 172.21.15.132:54318) 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 -- 172.21.15.132:0/951953770 learned_addr learned my addr 172.21.15.132:0/951953770 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:01.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dba0a3640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db40c8520 0x7f1db41f4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dba8a4640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db415bae0 0x7f1db4155d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 -- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db415bae0 msgr2=0x7f1db4155d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f1db415bae0 0x7f1db4155d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 -- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db40c8520 msgr2=0x7f1db41f4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f1db40c8520 0x7f1db41f4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 -- 172.21.15.132:0/951953770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db40c7760 con 0x7f1db415b700 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1db98a2640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db415b700 0x7f1db4153030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1da40098c0 tx=0x7f1da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4037050 con 0x7f1db415b700 2024-04-25T12:51:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1da4043070 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db4156250 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.592+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4006e10 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.593+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db4155150 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.593+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1db40c3cb0 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1da403ca50 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1daaffd640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d9806c8f0 0x7f1d9806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f1da40acb60 con 0x7f1db415b700 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1dba0a3640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d9806c8f0 0x7f1d9806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1daaffd640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7f1d98076380 0x7f1d98078820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 --> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1da402cea0 con 0x7f1d98076380 2024-04-25T12:51:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.594+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f1da40b12c0 con 0x7f1db415b700 2024-04-25T12:51:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.595+0000 7f1dba8a4640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7f1d98076380 0x7f1d98078820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.595+0000 7f1dba0a3640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d9806c8f0 0x7f1d9806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005880 tx=0x7f1db00057f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.595+0000 7f1dba8a4640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7f1d98076380 0x7f1d98078820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.596+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== osd.5 v2:172.21.15.157:6800/1305108505 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1da402cea0 con 0x7f1d98076380 2024-04-25T12:51:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.609+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 --> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1db4068da0 con 0x7f1d98076380 2024-04-25T12:51:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.609+0000 7f1daaffd640 1 -- 172.21.15.132:0/951953770 <== osd.5 v2:172.21.15.157:6800/1305108505 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1db4068da0 con 0x7f1d98076380 2024-04-25T12:51:01.607 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:51:01.608 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:51:01.608 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.609+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7f1d98076380 msgr2=0x7f1d98078820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.609+0000 7f1dbc307640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.157:6800/1305108505,v1:172.21.15.157:6801/1305108505] conn(0x7f1d98076380 0x7f1d98078820 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d9806c8f0 msgr2=0x7f1d9806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f1d9806c8f0 0x7f1d9806edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1db0005880 tx=0x7f1db00057f0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db415b700 msgr2=0x7f1db4153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 --2- 172.21.15.132:0/951953770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1db415b700 0x7f1db4153030 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f1da40098c0 tx=0x7f1da40046c0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dba8a4640 1 -- 172.21.15.132:0/951953770 reap_dead start 2024-04-25T12:51:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 shutdown_connections 2024-04-25T12:51:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 >> 172.21.15.132:0/951953770 conn(0x7f1db406d380 msgr2=0x7f1db406ecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 shutdown_connections 2024-04-25T12:51:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.610+0000 7f1dbc307640 1 -- 172.21.15.132:0/951953770 wait complete. 2024-04-25T12:51:01.618 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-25T12:51:01.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.719+0000 7f3b6c4cf640 1 Processor -- start 2024-04-25T12:51:01.718 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.719+0000 7f3b6c4cf640 1 -- start start 2024-04-25T12:51:01.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6c4cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b64153190 0x7f3b64073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.720 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6c4cf640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f3b640c6f50 0x7f3b640c5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6c4cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b641591b0 con 0x7f3b640c7330 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6c4cf640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f3b640cc4e0 con 0x7f3b640c6f50 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6c4cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3b64159450 con 0x7f3b64153190 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6aa6c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3b640c7330 0x7f3b640cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56332/0 (socket says 172.21.15.132:56332) 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6aa6c640 1 -- 172.21.15.132:0/3678674310 learned_addr learned my addr 172.21.15.132:0/3678674310 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b69a6a640 1 --2- 172.21.15.132:0/3678674310 >> v2:172.21.15.157:3300/0 conn(0x7f3b640c6f50 0x7f3b640c5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6a26b640 1 --2- 172.21.15.132:0/3678674310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b64153190 0x7f3b64073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.721 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b69269640 1 -- 172.21.15.132:0/3678674310 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827030672 0 0) 0x7f3b641591b0 con 0x7f3b640c7330 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b69269640 1 -- 172.21.15.132:0/3678674310 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b50003520 con 0x7f3b640c7330 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6a26b640 1 -- 172.21.15.132:0/3678674310 >> v2:172.21.15.157:3300/0 conn(0x7f3b640c6f50 msgr2=0x7f3b640c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6a26b640 1 --2- 172.21.15.132:0/3678674310 >> v2:172.21.15.157:3300/0 conn(0x7f3b640c6f50 0x7f3b640c5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6a26b640 1 -- 172.21.15.132:0/3678674310 >> v1:172.21.15.132:6789/0 conn(0x7f3b640c7330 legacy=0x7f3b640cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.720+0000 7f3b6a26b640 1 -- 172.21.15.132:0/3678674310 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b64158ee0 con 0x7f3b64153190 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.721+0000 7f3b6a26b640 1 --2- 172.21.15.132:0/3678674310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b64153190 0x7f3b64073bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009d90 tx=0x7f3b6002a6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f33ba0a75275f28d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.721+0000 7f3b69269640 1 -- 172.21.15.132:0/3678674310 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60007740 con 0x7f3b64153190 2024-04-25T12:51:01.722 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.721+0000 7f3b69269640 1 -- 172.21.15.132:0/3678674310 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b600078e0 con 0x7f3b64153190 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.721+0000 7f3b69269640 1 -- 172.21.15.132:0/3678674310 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60007c90 con 0x7f3b64153190 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/3678674310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b64153190 msgr2=0x7f3b64073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/3678674310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b64153190 0x7f3b64073bc0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009d90 tx=0x7f3b6002a6f0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/3678674310 shutdown_connections 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/3678674310 >> v2:172.21.15.157:3300/0 conn(0x7f3b640c6f50 0x7f3b640c5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/3678674310 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b64153190 0x7f3b64073bc0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/3678674310 >> 172.21.15.132:0/3678674310 conn(0x7f3b64075db0 msgr2=0x7f3b64067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/3678674310 shutdown_connections 2024-04-25T12:51:01.723 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.722+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/3678674310 wait complete. 2024-04-25T12:51:01.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.723+0000 7f3b6c4cf640 1 Processor -- start 2024-04-25T12:51:01.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.723+0000 7f3b6c4cf640 1 -- start start 2024-04-25T12:51:01.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6c4cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 0x7f3b641511a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6c4cf640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b640c7330 0x7f3b64156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.726 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6c4cf640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b64153190 0x7f3b64153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6c4cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f3b64159cd0 con 0x7f3b640c6f50 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6c4cf640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f3b641599f0 con 0x7f3b64153190 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6c4cf640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f3b640cd0d0 con 0x7f3b640c7330 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 0x7f3b641511a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 0x7f3b641511a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54322/0 (socket says 172.21.15.132:54322) 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 -- 172.21.15.132:0/458056040 learned_addr learned my addr 172.21.15.132:0/458056040 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6aa6c640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b64153190 0x7f3b64153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.727 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 -- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b640c7330 msgr2=0x7f3b64156160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b640c7330 0x7f3b64156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 -- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b64153190 msgr2=0x7f3b64153a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b64153190 0x7f3b64153a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 -- 172.21.15.132:0/458056040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6415cec0 con 0x7f3b640c6f50 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b6a26b640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 0x7f3b641511a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009eb0 tx=0x7f3b60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6003f070 con 0x7f3b640c6f50 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.724+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b60031c40 con 0x7f3b640c6f50 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.725+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b64154ee0 con 0x7f3b640c6f50 2024-04-25T12:51:01.728 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.725+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60009450 con 0x7f3b640c6f50 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.725+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b641e2900 con 0x7f3b640c6f50 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.725+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b64069330 con 0x7f3b640c6f50 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.726+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3b6003b410 con 0x7f3b640c6f50 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.726+0000 7f3b5affd640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b4806c8f0 0x7f3b4806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.727+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f3b600ad0a0 con 0x7f3b640c6f50 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.727+0000 7f3b69a6a640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b4806c8f0 0x7f3b4806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:01.729 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.727+0000 7f3b69a6a640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b4806c8f0 0x7f3b4806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006a90 tx=0x7f3b54006a20 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:01.730 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.731+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3b64069330 con 0x7f3b640c6f50 2024-04-25T12:51:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.907+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f3b64072a20 con 0x7f3b4806c8f0 2024-04-25T12:51:01.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.907+0000 7f3b5affd640 1 -- 172.21.15.132:0/458056040 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f3b64072a20 con 0x7f3b4806c8f0 2024-04-25T12:51:01.906 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 5 to deep-scrub 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b4806c8f0 msgr2=0x7f3b4806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b4806c8f0 0x7f3b4806edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3b54006a90 tx=0x7f3b54006a20 comp rx=0 tx=0).stop 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 msgr2=0x7f3b641511a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 0x7f3b641511a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009eb0 tx=0x7f3b60004a40 comp rx=0 tx=0).stop 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 shutdown_connections 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f3b4806c8f0 0x7f3b4806edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f3b64153190 0x7f3b64153a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f3b640c7330 0x7f3b64156160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 --2- 172.21.15.132:0/458056040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b640c6f50 0x7f3b641511a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 >> 172.21.15.132:0/458056040 conn(0x7f3b64075db0 msgr2=0x7f3b640c7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 shutdown_connections 2024-04-25T12:51:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:01.909+0000 7f3b6c4cf640 1 -- 172.21.15.132:0/458056040 wait complete. 2024-04-25T12:51:01.919 INFO:tasks.ceph:Scrubbing osd.6 2024-04-25T12:51:01.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:51:02.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.023+0000 7fa24aa10640 1 Processor -- start 2024-04-25T12:51:02.021 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.023+0000 7fa24aa10640 1 -- start start 2024-04-25T12:51:02.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.023+0000 7fa24aa10640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 0x7fa24415b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.023+0000 7fa24aa10640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 0x7fa24415f160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa24aa10640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa24415b960 con 0x7fa2440c8b50 2024-04-25T12:51:02.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa24aa10640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fa24415c200 con 0x7fa2440c7350 2024-04-25T12:51:02.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa24aa10640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa24415bc40 con 0x7fa244155740 2024-04-25T12:51:02.024 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa2437fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 0x7fa24415f160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa243fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 0x7fa24415b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa2437fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 0x7fa24415f160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:50698/0 (socket says 172.21.15.132:50698) 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa243fff640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 0x7fa24415b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:56530/0 (socket says 172.21.15.132:56530) 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa248fad640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fa2440c8b50 0x7fa2440c90c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:48676/0 (socket says 172.21.15.132:48676) 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa2437fe640 1 -- 172.21.15.132:0/1699345280 learned_addr learned my addr 172.21.15.132:0/1699345280 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa243fff640 1 -- 172.21.15.132:0/1699345280 >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 msgr2=0x7fa24415f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa243fff640 1 --2- 172.21.15.132:0/1699345280 >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 0x7fa24415f160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.025 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa243fff640 1 -- 172.21.15.132:0/1699345280 >> v1:172.21.15.157:6789/0 conn(0x7fa2440c8b50 legacy=0x7fa2440c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa243fff640 1 -- 172.21.15.132:0/1699345280 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24415bf20 con 0x7fa244155740 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa242ffd640 1 -- 172.21.15.132:0/1699345280 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047141363 0 0) 0x7fa24415b960 con 0x7fa2440c8b50 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.024+0000 7fa2437fe640 1 --2- 172.21.15.132:0/1699345280 >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 0x7fa24415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.025+0000 7fa243fff640 1 --2- 172.21.15.132:0/1699345280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 0x7fa24415b240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097a0 tx=0x7fa23402a100 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef8d8764ab3972d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.025+0000 7fa242ffd640 1 -- 172.21.15.132:0/1699345280 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037070 con 0x7fa244155740 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.025+0000 7fa242ffd640 1 -- 172.21.15.132:0/1699345280 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa23402ae50 con 0x7fa244155740 2024-04-25T12:51:02.026 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.025+0000 7fa242ffd640 1 -- 172.21.15.132:0/1699345280 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234032660 con 0x7fa244155740 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 -- 172.21.15.132:0/1699345280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 msgr2=0x7fa24415b240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 --2- 172.21.15.132:0/1699345280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 0x7fa24415b240 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097a0 tx=0x7fa23402a100 comp rx=0 tx=0).stop 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 -- 172.21.15.132:0/1699345280 shutdown_connections 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 --2- 172.21.15.132:0/1699345280 >> v2:172.21.15.157:3300/0 conn(0x7fa2440c7350 0x7fa24415f160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 --2- 172.21.15.132:0/1699345280 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa244155740 0x7fa24415b240 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 -- 172.21.15.132:0/1699345280 >> 172.21.15.132:0/1699345280 conn(0x7fa24406d380 msgr2=0x7fa244067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 -- 172.21.15.132:0/1699345280 shutdown_connections 2024-04-25T12:51:02.027 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.026+0000 7fa24aa10640 1 -- 172.21.15.132:0/1699345280 wait complete. 2024-04-25T12:51:02.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.027+0000 7fa24aa10640 1 Processor -- start 2024-04-25T12:51:02.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.027+0000 7fa24aa10640 1 -- start start 2024-04-25T12:51:02.031 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440c7350 0x7fa244158740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2440c8b50 0x7fa24415c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa244155740 0x7fa24415c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fa24415f6a0 con 0x7fa2440c7350 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fa24415ec40 con 0x7fa244155740 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fa2440c97d0 con 0x7fa2440c8b50 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440c7350 0x7fa244158740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440c7350 0x7fa244158740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54326/0 (socket says 172.21.15.132:54326) 2024-04-25T12:51:02.032 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 -- 172.21.15.132:0/3276569775 learned_addr learned my addr 172.21.15.132:0/3276569775 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa248fad640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa244155740 0x7fa24415c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa2437fe640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2440c8b50 0x7fa24415c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 -- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2440c8b50 msgr2=0x7fa24415c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fa2440c8b50 0x7fa24415c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 -- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa244155740 msgr2=0x7fa24415c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fa244155740 0x7fa24415c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 -- 172.21.15.132:0/3276569775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2441571d0 con 0x7fa2440c7350 2024-04-25T12:51:02.033 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa243fff640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440c7350 0x7fa244158740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097a0 tx=0x7fa2340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234037040 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa234004030 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa234004420 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2441e70c0 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.028+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2441569d0 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.029+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2441e73a0 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa234003610 con 0x7fa2440c7350 2024-04-25T12:51:02.034 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa240ff9640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fa2340acba0 con 0x7fa2440c7350 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa2437fe640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa23006c8f0 0x7fa23006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa240ff9640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7fa230076390 0x7fa230078830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 --> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa234043e70 con 0x7fa230076390 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.030+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fa2340b12c0 con 0x7fa2440c7350 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.031+0000 7fa248fad640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7fa230076390 0x7fa230078830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.035 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.031+0000 7fa2437fe640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa23006c8f0 0x7fa23006edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa244158c80 tx=0x7fa238009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.031+0000 7fa248fad640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7fa230076390 0x7fa230078830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.036 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.032+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== osd.6 v2:172.21.15.157:6816/898532685 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa234043e70 con 0x7fa230076390 2024-04-25T12:51:02.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.045+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 --> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa244068da0 con 0x7fa230076390 2024-04-25T12:51:02.043 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa240ff9640 1 -- 172.21.15.132:0/3276569775 <== osd.6 v2:172.21.15.157:6816/898532685 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa244068da0 con 0x7fa230076390 2024-04-25T12:51:02.044 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:51:02.044 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:51:02.044 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:51:02.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7fa230076390 msgr2=0x7fa230078830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.157:6816/898532685,v1:172.21.15.157:6817/898532685] conn(0x7fa230076390 0x7fa230078830 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa23006c8f0 msgr2=0x7fa23006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.045 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fa23006c8f0 0x7fa23006edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa244158c80 tx=0x7fa238009240 comp rx=0 tx=0).stop 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440c7350 msgr2=0x7fa244158740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 --2- 172.21.15.132:0/3276569775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2440c7350 0x7fa244158740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa2340097a0 tx=0x7fa2340046c0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa248fad640 1 -- 172.21.15.132:0/3276569775 reap_dead start 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 shutdown_connections 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 >> 172.21.15.132:0/3276569775 conn(0x7fa24406d380 msgr2=0x7fa244067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 shutdown_connections 2024-04-25T12:51:02.046 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.046+0000 7fa24aa10640 1 -- 172.21.15.132:0/3276569775 wait complete. 2024-04-25T12:51:02.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-25T12:51:02.153 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.155+0000 7eff1b869640 1 Processor -- start 2024-04-25T12:51:02.154 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.155+0000 7eff1b869640 1 -- start start 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff1b869640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7eff14153190 0x7eff14073bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff1b869640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff141591b0 con 0x7eff140c7360 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff1b869640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff140cc4e0 con 0x7eff140c6f50 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff1b869640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7eff14159450 con 0x7eff14153190 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff19e06640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7eff140c7360 0x7eff140cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56334/0 (socket says 172.21.15.132:56334) 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff19e06640 1 -- 172.21.15.132:0/2513008287 learned_addr learned my addr 172.21.15.132:0/2513008287 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff19605640 1 --2- 172.21.15.132:0/2513008287 >> v2:172.21.15.157:3300/0 conn(0x7eff14153190 0x7eff14073bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.156 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.156+0000 7eff0bfff640 1 -- 172.21.15.132:0/2513008287 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 677665881 0 0) 0x7eff141591b0 con 0x7eff140c7360 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.157+0000 7eff0bfff640 1 -- 172.21.15.132:0/2513008287 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff00003520 con 0x7eff140c7360 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.157+0000 7eff0bfff640 1 -- 172.21.15.132:0/2513008287 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1314512315 0 0) 0x7eff00003520 con 0x7eff140c7360 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.157+0000 7eff19605640 1 -- 172.21.15.132:0/2513008287 >> v1:172.21.15.157:6789/0 conn(0x7eff140c6f50 legacy=0x7eff140c5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.157+0000 7eff19605640 1 -- 172.21.15.132:0/2513008287 >> v1:172.21.15.132:6789/0 conn(0x7eff140c7360 legacy=0x7eff140cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.157+0000 7eff19605640 1 -- 172.21.15.132:0/2513008287 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff14158ee0 con 0x7eff14153190 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.157+0000 7eff19605640 1 --2- 172.21.15.132:0/2513008287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14073bc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009d90 tx=0x7eff0c02a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0f394faaba7f232 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff0bfff640 1 -- 172.21.15.132:0/2513008287 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff10001670 con 0x7eff14153190 2024-04-25T12:51:02.157 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff0bfff640 1 -- 172.21.15.132:0/2513008287 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff0c007540 con 0x7eff14153190 2024-04-25T12:51:02.158 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff0bfff640 1 -- 172.21.15.132:0/2513008287 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff0c0078f0 con 0x7eff14153190 2024-04-25T12:51:02.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 -- 172.21.15.132:0/2513008287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 msgr2=0x7eff14073bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.161 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 --2- 172.21.15.132:0/2513008287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14073bc0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7eff0c009d90 tx=0x7eff0c02a710 comp rx=0 tx=0).stop 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 -- 172.21.15.132:0/2513008287 shutdown_connections 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 --2- 172.21.15.132:0/2513008287 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14073bc0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 -- 172.21.15.132:0/2513008287 >> 172.21.15.132:0/2513008287 conn(0x7eff14075db0 msgr2=0x7eff14067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 -- 172.21.15.132:0/2513008287 shutdown_connections 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.158+0000 7eff1b869640 1 -- 172.21.15.132:0/2513008287 wait complete. 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.159+0000 7eff1b869640 1 Processor -- start 2024-04-25T12:51:02.162 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 -- start start 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff140c6f50 0x7eff141f31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 0x7eff14153a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7eff14159cd0 con 0x7eff140c7360 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7eff141599f0 con 0x7eff14153190 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff1b869640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7eff140c6370 con 0x7eff140c6f50 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff18e04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 0x7eff14153a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff18e04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 0x7eff14153a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54332/0 (socket says 172.21.15.132:54332) 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff18e04640 1 -- 172.21.15.132:0/1763879315 learned_addr learned my addr 172.21.15.132:0/1763879315 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.163 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff19e06640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.160+0000 7eff19605640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff140c6f50 0x7eff141f31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff18e04640 1 -- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff140c6f50 msgr2=0x7eff141f31e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff18e04640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff140c6f50 0x7eff141f31e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff18e04640 1 -- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 msgr2=0x7eff14156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff18e04640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff18e04640 1 -- 172.21.15.132:0/1763879315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff1414db90 con 0x7eff140c7360 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff18e04640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 0x7eff14153a40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c4d0 tx=0x7eff0400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff040052d0 con 0x7eff140c7360 2024-04-25T12:51:02.164 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff04005470 con 0x7eff140c7360 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff1414d5d0 con 0x7eff140c7360 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff04012850 con 0x7eff140c7360 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.161+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff14155910 con 0x7eff140c7360 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.162+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff140c6160 con 0x7eff140c7360 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.163+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7eff040129f0 con 0x7eff140c7360 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.163+0000 7eff09ffb640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efef806c8f0 0x7efef806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.163+0000 7eff19605640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efef806c8f0 0x7efef806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.163+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7eff0408b9e0 con 0x7eff140c7360 2024-04-25T12:51:02.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.164+0000 7eff19605640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efef806c8f0 0x7efef806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff0c034000 tx=0x7eff0c02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.166 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.167+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7eff140c6160 con 0x7eff140c7360 2024-04-25T12:51:02.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.343+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7eff1414d380 con 0x7efef806c8f0 2024-04-25T12:51:02.342 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.344+0000 7eff09ffb640 1 -- 172.21.15.132:0/1763879315 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7eff1414d380 con 0x7efef806c8f0 2024-04-25T12:51:02.342 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 6 to deep-scrub 2024-04-25T12:51:02.344 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efef806c8f0 msgr2=0x7efef806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efef806c8f0 0x7efef806edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7eff0c034000 tx=0x7eff0c02f000 comp rx=0 tx=0).stop 2024-04-25T12:51:02.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 msgr2=0x7eff14153a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 0x7eff14153a40 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7eff0400c4d0 tx=0x7eff0400c990 comp rx=0 tx=0).stop 2024-04-25T12:51:02.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 shutdown_connections 2024-04-25T12:51:02.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7efef806c8f0 0x7efef806edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.345 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7eff14153190 0x7eff14156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff140c7360 0x7eff14153a40 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 --2- 172.21.15.132:0/1763879315 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7eff140c6f50 0x7eff141f31e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 >> 172.21.15.132:0/1763879315 conn(0x7eff14075db0 msgr2=0x7eff14157d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 shutdown_connections 2024-04-25T12:51:02.346 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.346+0000 7eff1b869640 1 -- 172.21.15.132:0/1763879315 wait complete. 2024-04-25T12:51:02.355 INFO:tasks.ceph:Scrubbing osd.7 2024-04-25T12:51:02.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-25T12:51:02.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.458+0000 7f7c4b059640 1 Processor -- start 2024-04-25T12:51:02.456 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.458+0000 7f7c4b059640 1 -- start start 2024-04-25T12:51:02.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.458+0000 7f7c4b059640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7c440ceab0 0x7f7c440c6670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.458+0000 7f7c4b059640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440cee90 0x7f7c440c95e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c4b059640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c440c9b20 0x7f7c4414f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c4b059640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f7c440c8db0 con 0x7f7c440c9b20 2024-04-25T12:51:02.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c4b059640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7c440c8510 con 0x7f7c440ceab0 2024-04-25T12:51:02.459 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c4b059640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440c87f0 con 0x7f7c440cee90 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c440c9b20 0x7f7c4414f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c440c9b20 0x7f7c4414f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:54340/0 (socket says 172.21.15.132:54340) 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 -- 172.21.15.132:0/2797999367 learned_addr learned my addr 172.21.15.132:0/2797999367 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c43fff640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440cee90 0x7f7c440c95e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c48df5640 1 --2- 172.21.15.132:0/2797999367 >> v2:172.21.15.157:3300/0 conn(0x7f7c440ceab0 0x7f7c440c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 -- 172.21.15.132:0/2797999367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440cee90 msgr2=0x7f7c440c95e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440cee90 0x7f7c440c95e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 -- 172.21.15.132:0/2797999367 >> v2:172.21.15.157:3300/0 conn(0x7f7c440ceab0 msgr2=0x7f7c440c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 --2- 172.21.15.132:0/2797999367 >> v2:172.21.15.157:3300/0 conn(0x7f7c440ceab0 0x7f7c440c6670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c495f6640 1 -- 172.21.15.132:0/2797999367 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c440c8ad0 con 0x7f7c440c9b20 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.459+0000 7f7c43fff640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440cee90 0x7f7c440c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c495f6640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c4414f5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c440cf890 tx=0x7f7c3c02a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6988555dc5193a05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c437fe640 1 -- 172.21.15.132:0/2797999367 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c036070 con 0x7f7c440c9b20 2024-04-25T12:51:02.461 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c437fe640 1 -- 172.21.15.132:0/2797999367 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3c031600 con 0x7f7c440c9b20 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c437fe640 1 -- 172.21.15.132:0/2797999367 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3c0319d0 con 0x7f7c440c9b20 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 -- 172.21.15.132:0/2797999367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 msgr2=0x7f7c4414f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c4414f5a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7c440cf890 tx=0x7f7c3c02a6a0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 -- 172.21.15.132:0/2797999367 shutdown_connections 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c4414f5a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 --2- 172.21.15.132:0/2797999367 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440cee90 0x7f7c440c95e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 --2- 172.21.15.132:0/2797999367 >> v2:172.21.15.157:3300/0 conn(0x7f7c440ceab0 0x7f7c440c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 -- 172.21.15.132:0/2797999367 >> 172.21.15.132:0/2797999367 conn(0x7f7c44070ab0 msgr2=0x7f7c44070e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 -- 172.21.15.132:0/2797999367 shutdown_connections 2024-04-25T12:51:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.460+0000 7f7c4b059640 1 -- 172.21.15.132:0/2797999367 wait complete. 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 Processor -- start 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 -- start start 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c44142240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440ceab0 0x7f7c44157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c440cee90 0x7f7c440cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440c81d0 con 0x7f7c440c9b20 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4406fde0 con 0x7f7c440cee90 2024-04-25T12:51:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c4b059640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440c6bb0 con 0x7f7c440ceab0 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c48df5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c44142240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c48df5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c44142240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50750/0 (socket says 172.21.15.132:50750) 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.462+0000 7f7c48df5640 1 -- 172.21.15.132:0/1963437358 learned_addr learned my addr 172.21.15.132:0/1963437358 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c495f6640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c440cee90 0x7f7c440cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c43fff640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440ceab0 0x7f7c44157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c48df5640 1 -- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440ceab0 msgr2=0x7f7c44157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c48df5640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440ceab0 0x7f7c44157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c48df5640 1 -- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c440cee90 msgr2=0x7f7c440cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c48df5640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c440cee90 0x7f7c440cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c48df5640 1 -- 172.21.15.132:0/1963437358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c44140be0 con 0x7f7c440c9b20 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c43fff640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7c440ceab0 0x7f7c44157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c495f6640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7c440cee90 0x7f7c440cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c48df5640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c44142240 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800e8d0 tx=0x7f7c3800ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c38017070 con 0x7f7c440c9b20 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c3800c940 con 0x7f7c440c9b20 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c3800cd30 con 0x7f7c440c9b20 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c44149a80 con 0x7f7c440c9b20 2024-04-25T12:51:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.463+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4414a040 con 0x7f7c440c9b20 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.464+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7c44068da0 con 0x7f7c440c9b20 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.464+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c3801a070 con 0x7f7c440c9b20 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c417fa640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7c2806c920 0x7f7c2806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7c3808c060 con 0x7f7c440c9b20 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c43fff640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7c2806c920 0x7f7c2806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c417fa640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f7c280763b0 0x7f7c28078850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 --> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7c3800ae90 con 0x7f7c280763b0 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f7c38093050 con 0x7f7c440c9b20 2024-04-25T12:51:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c43fff640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7c2806c920 0x7f7c2806ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c441590c0 tx=0x7f7c30008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.465+0000 7f7c495f6640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f7c280763b0 0x7f7c28078850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.466+0000 7f7c495f6640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f7c280763b0 0x7f7c28078850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.466+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== osd.7 v2:172.21.15.157:6808/3050581758 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7c3800ae90 con 0x7f7c280763b0 2024-04-25T12:51:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 --> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7c440c5650 con 0x7f7c280763b0 2024-04-25T12:51:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c417fa640 1 -- 172.21.15.132:0/1963437358 <== osd.7 v2:172.21.15.157:6808/3050581758 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7c440c5650 con 0x7f7c280763b0 2024-04-25T12:51:02.479 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2024-04-25T12:51:02.479 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T12:51:02.479 INFO:teuthology.orchestra.run.smithi132.stdout:} 2024-04-25T12:51:02.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f7c280763b0 msgr2=0x7f7c28078850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.157:6808/3050581758,v1:172.21.15.157:6809/3050581758] conn(0x7f7c280763b0 0x7f7c28078850 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7c2806c920 msgr2=0x7f7c2806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7c2806c920 0x7f7c2806ede0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7c441590c0 tx=0x7f7c30008040 comp rx=0 tx=0).stop 2024-04-25T12:51:02.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 msgr2=0x7f7c44142240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.480 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 --2- 172.21.15.132:0/1963437358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c440c9b20 0x7f7c44142240 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800e8d0 tx=0x7f7c3800ed90 comp rx=0 tx=0).stop 2024-04-25T12:51:02.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c495f6640 1 -- 172.21.15.132:0/1963437358 reap_dead start 2024-04-25T12:51:02.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 shutdown_connections 2024-04-25T12:51:02.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.480+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 >> 172.21.15.132:0/1963437358 conn(0x7f7c44070ab0 msgr2=0x7f7c4414d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.481+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 shutdown_connections 2024-04-25T12:51:02.481 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.481+0000 7f7c4b059640 1 -- 172.21.15.132:0/1963437358 wait complete. 2024-04-25T12:51:02.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-25T12:51:02.596 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.589+0000 7fcb1efe2640 1 Processor -- start 2024-04-25T12:51:02.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.589+0000 7fcb1efe2640 1 -- start start 2024-04-25T12:51:02.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb1efe2640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fcb180c3a50 0x7fcb181575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb1efe2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb18157c80 con 0x7fcb180c95f0 2024-04-25T12:51:02.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb1efe2640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb18157f60 con 0x7fcb181519c0 2024-04-25T12:51:02.597 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb1efe2640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fcb18151da0 con 0x7fcb180c3a50 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb1d57f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb180c95f0 0x7fcb180c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57042/0 (socket says 172.21.15.132:57042) 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb1d57f640 1 -- 172.21.15.132:0/21515182 learned_addr learned my addr 172.21.15.132:0/21515182 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254012164 0 0) 0x7fcb18157c80 con 0x7fcb180c95f0 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb00004630 con 0x7fcb180c95f0 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.590+0000 7fcb17fff640 1 --2- 172.21.15.132:0/21515182 >> v2:172.21.15.157:3300/0 conn(0x7fcb180c3a50 0x7fcb181575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1657879900 0 0) 0x7fcb00004630 con 0x7fcb180c95f0 2024-04-25T12:51:02.598 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 >> v2:172.21.15.157:3300/0 conn(0x7fcb180c3a50 msgr2=0x7fcb181575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 --2- 172.21.15.132:0/21515182 >> v2:172.21.15.157:3300/0 conn(0x7fcb180c3a50 0x7fcb181575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 >> v1:172.21.15.157:6789/0 conn(0x7fcb181519c0 legacy=0x7fcb180736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb18158240 con 0x7fcb180c95f0 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7fcb100019f0 con 0x7fcb180c95f0 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 >> v1:172.21.15.132:6789/0 conn(0x7fcb180c95f0 legacy=0x7fcb180c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb00004ac0 0x7fcb00004ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb00005910 0x7fcb00005d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.599 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb000062d0 0x7fcb0000cad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18151da0 con 0x7fcb00005910 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcb0000d170 con 0x7fcb00004ac0 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcb0000d370 con 0x7fcb000062d0 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb17fff640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb00005910 0x7fcb00005d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb1cd7e640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb00004ac0 0x7fcb00004ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb1d57f640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb000062d0 0x7fcb0000cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb17fff640 1 -- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb000062d0 msgr2=0x7fcb0000cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:02.600 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb17fff640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb000062d0 0x7fcb0000cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb17fff640 1 -- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb00004ac0 msgr2=0x7fcb00004ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb17fff640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb00004ac0 0x7fcb00004ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb17fff640 1 -- 172.21.15.132:0/21515182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb00004630 con 0x7fcb00005910 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb1d57f640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb000062d0 0x7fcb0000cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.591+0000 7fcb1d57f640 1 -- 172.21.15.132:0/21515182 reap_dead start 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb17fff640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb00005910 0x7fcb00005d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009ac0 tx=0x7fcb00006940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36c3c3eb01d89e67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.601 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c036070 con 0x7fcb00005910 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb0c031400 con 0x7fcb00005910 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb177fe640 1 -- 172.21.15.132:0/21515182 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb0c009690 con 0x7fcb00005910 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 -- 172.21.15.132:0/21515182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb00005910 msgr2=0x7fcb00005d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb00005910 0x7fcb00005d90 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb0c009ac0 tx=0x7fcb00006940 comp rx=0 tx=0).stop 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 -- 172.21.15.132:0/21515182 shutdown_connections 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/21515182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb00005910 0x7fcb00005d90 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.602 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 -- 172.21.15.132:0/21515182 >> 172.21.15.132:0/21515182 conn(0x7fcb18075db0 msgr2=0x7fcb18067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 -- 172.21.15.132:0/21515182 shutdown_connections 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.592+0000 7fcb1efe2640 1 -- 172.21.15.132:0/21515182 wait complete. 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 Processor -- start 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 -- start start 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb00005910 0x7fcb18146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb18143e50 0x7fcb181546b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 0x7fcb181f0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.603 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fcb180c73f0 con 0x7fcb18154bf0 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fcb18158520 con 0x7fcb18143e50 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.594+0000 7fcb1efe2640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fcb181575d0 con 0x7fcb00005910 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 0x7fcb181f0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 0x7fcb181f0000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50778/0 (socket says 172.21.15.132:50778) 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 -- 172.21.15.132:0/1011768792 learned_addr learned my addr 172.21.15.132:0/1011768792 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1cd7e640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb00005910 0x7fcb18146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.604 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb17fff640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb18143e50 0x7fcb181546b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 -- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb00005910 msgr2=0x7fcb18146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb00005910 0x7fcb18146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 -- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb18143e50 msgr2=0x7fcb181546b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb18143e50 0x7fcb181546b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 -- 172.21.15.132:0/1011768792 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb18152190 con 0x7fcb18154bf0 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb17fff640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb18143e50 0x7fcb181546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1d57f640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 0x7fcb181f0000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcb10002230 tx=0x7fcb1000e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb1000eb30 con 0x7fcb18154bf0 2024-04-25T12:51:02.605 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb1000ecd0 con 0x7fcb18154bf0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb18152470 con 0x7fcb18154bf0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb10014670 con 0x7fcb18154bf0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.595+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb181564b0 con 0x7fcb18154bf0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.596+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb18146140 con 0x7fcb18154bf0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.597+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcb10014810 con 0x7fcb18154bf0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.597+0000 7fcb157fa640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcb0406c920 0x7fcb0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.597+0000 7fcb1cd7e640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcb0406c920 0x7fcb0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.606 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.597+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7fcb1008bbd0 con 0x7fcb18154bf0 2024-04-25T12:51:02.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.598+0000 7fcb1cd7e640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcb0406c920 0x7fcb0406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb08000c00 tx=0x7fcb08009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.607 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.602+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcb10059be0 con 0x7fcb18154bf0 2024-04-25T12:51:02.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.779+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fcb18151f40 con 0x7fcb0406c920 2024-04-25T12:51:02.778 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.780+0000 7fcb157fa640 1 -- 172.21.15.132:0/1011768792 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcb18151f40 con 0x7fcb0406c920 2024-04-25T12:51:02.778 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 7 to deep-scrub 2024-04-25T12:51:02.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcb0406c920 msgr2=0x7fcb0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.780 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcb0406c920 0x7fcb0406ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcb08000c00 tx=0x7fcb08009040 comp rx=0 tx=0).stop 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 msgr2=0x7fcb181f0000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 0x7fcb181f0000 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fcb10002230 tx=0x7fcb1000e530 comp rx=0 tx=0).stop 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 shutdown_connections 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fcb0406c920 0x7fcb0406ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb18154bf0 0x7fcb181f0000 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fcb18143e50 0x7fcb181546b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.781 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 --2- 172.21.15.132:0/1011768792 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fcb00005910 0x7fcb18146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 >> 172.21.15.132:0/1011768792 conn(0x7fcb18075db0 msgr2=0x7fcb18156ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 shutdown_connections 2024-04-25T12:51:02.782 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.782+0000 7fcb1efe2640 1 -- 172.21.15.132:0/1011768792 wait complete. 2024-04-25T12:51:02.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:51:02.887 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.889+0000 7f2cf3cef640 1 Processor -- start 2024-04-25T12:51:02.888 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.889+0000 7f2cf3cef640 1 -- start start 2024-04-25T12:51:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.890+0000 7f2cf3cef640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec0cba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.890+0000 7f2cf3cef640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec0cc3d0 con 0x7f2cec0cc730 2024-04-25T12:51:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.890+0000 7f2cf3cef640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cec15ed80 con 0x7f2cec0cbf70 2024-04-25T12:51:02.890 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.890+0000 7f2cf3cef640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec0cb5a0 con 0x7f2cec1557e0 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.890+0000 7f2cf128a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2cec0cc730 0x7f2cec06c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57054/0 (socket says 172.21.15.132:57054) 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.890+0000 7f2cf128a640 1 -- 172.21.15.132:0/2592539597 learned_addr learned my addr 172.21.15.132:0/2592539597 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf1a8b640 1 --2- 172.21.15.132:0/2592539597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec0cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418800553 0 0) 0x7f2cec0cc3d0 con 0x7f2cec0cc730 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cd8003520 con 0x7f2cec0cc730 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172082444 0 0) 0x7f2cec15ed80 con 0x7f2cec0cbf70 2024-04-25T12:51:02.891 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2cec0cc3d0 con 0x7f2cec0cbf70 2024-04-25T12:51:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/2592539597 >> v1:172.21.15.157:6789/0 conn(0x7f2cec0cbf70 legacy=0x7f2cec06d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/2592539597 >> v1:172.21.15.132:6789/0 conn(0x7f2cec0cc730 legacy=0x7f2cec06c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.891+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/2592539597 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec15f060 con 0x7f2cec1557e0 2024-04-25T12:51:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.892+0000 7f2cf1a8b640 1 --2- 172.21.15.132:0/2592539597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec0cba30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009dc0 tx=0x7f2ce802a6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b87b2b805ae8123 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.892 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.892+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 <== mon.2 v2:172.21.15.157:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8007740 con 0x7f2cec1557e0 2024-04-25T12:51:02.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.892+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 <== mon.2 v2:172.21.15.157:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce80078e0 con 0x7f2cec1557e0 2024-04-25T12:51:02.893 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.892+0000 7f2cf0a89640 1 -- 172.21.15.132:0/2592539597 <== mon.2 v2:172.21.15.157:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8007c90 con 0x7f2cec1557e0 2024-04-25T12:51:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 -- 172.21.15.132:0/2592539597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 msgr2=0x7f2cec0cba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/2592539597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec0cba30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009dc0 tx=0x7f2ce802a6d0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 -- 172.21.15.132:0/2592539597 shutdown_connections 2024-04-25T12:51:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/2592539597 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec0cba30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.897 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 -- 172.21.15.132:0/2592539597 >> 172.21.15.132:0/2592539597 conn(0x7f2cec0d0e10 msgr2=0x7f2cec0d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 -- 172.21.15.132:0/2592539597 shutdown_connections 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.893+0000 7f2cf3cef640 1 -- 172.21.15.132:0/2592539597 wait complete. 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 Processor -- start 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 -- start start 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 0x7f2cec1f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cec0cc730 0x7f2cec1f4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec14d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec0cd0c0 con 0x7f2cec0cbf70 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.894+0000 7f2cf3cef640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec15f620 con 0x7f2cec0cc730 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf3cef640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2cec0cd240 con 0x7f2cec1557e0 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 0x7f2cec1f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 0x7f2cec1f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50790/0 (socket says 172.21.15.132:50790) 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/965774986 learned_addr learned my addr 172.21.15.132:0/965774986 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:02.899 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf128a640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cec0cc730 0x7f2cec1f4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf228c640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec14d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 msgr2=0x7f2cec14d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec14d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cec0cc730 msgr2=0x7f2cec1f4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cec0cc730 0x7f2cec1f4af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 -- 172.21.15.132:0/965774986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec1502f0 con 0x7f2cec0cbf70 2024-04-25T12:51:02.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf1a8b640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 0x7f2cec1f45b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009ee0 tx=0x7f2ce8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8009450 con 0x7f2cec0cbf70 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ce8004240 con 0x7f2cec0cbf70 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec1505b0 con 0x7f2cec0cbf70 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce8004630 con 0x7f2cec0cbf70 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.895+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec1f5180 con 0x7f2cec0cbf70 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.896+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cec068c20 con 0x7f2cec0cbf70 2024-04-25T12:51:02.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.897+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ce803b410 con 0x7f2cec0cbf70 2024-04-25T12:51:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.897+0000 7f2ce27fc640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2cd006c8f0 0x7f2cd006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.897+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2ce80ace80 con 0x7f2cec0cbf70 2024-04-25T12:51:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.897+0000 7f2cf128a640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2cd006c8f0 0x7f2cd006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:02.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.898+0000 7f2cf128a640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2cd006c8f0 0x7f2cd006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b6650 tx=0x7f2cdc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:02.903 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:02.901+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ce803f030 con 0x7f2cec0cbf70 2024-04-25T12:51:03.068 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.070+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2cec14d110 con 0x7f2cd006c8f0 2024-04-25T12:51:03.076 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.078+0000 7f2ce27fc640 1 -- 172.21.15.132:0/965774986 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332574 (secure 0 0 0) 0x7f2cec14d110 con 0x7f2cd006c8f0 2024-04-25T12:51:03.080 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:51:03.082 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:51:03.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2cd006c8f0 msgr2=0x7f2cd006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:03.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2cd006c8f0 0x7f2cd006edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0b6650 tx=0x7f2cdc009040 comp rx=0 tx=0).stop 2024-04-25T12:51:03.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 msgr2=0x7f2cec1f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:03.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 0x7f2cec1f45b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8009ee0 tx=0x7f2ce8004a40 comp rx=0 tx=0).stop 2024-04-25T12:51:03.084 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 shutdown_connections 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2cd006c8f0 0x7f2cd006edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2cec1557e0 0x7f2cec14d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2cec0cc730 0x7f2cec1f4af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 --2- 172.21.15.132:0/965774986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2cec0cbf70 0x7f2cec1f45b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 >> 172.21.15.132:0/965774986 conn(0x7f2cec0d0e10 msgr2=0x7f2cec154870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.081+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 shutdown_connections 2024-04-25T12:51:03.085 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:03.082+0000 7f2cf3cef640 1 -- 172.21.15.132:0/965774986 wait complete. 2024-04-25T12:51:03.091 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":51,"stamp":"2024-04-25T12:51:01.137793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595405,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":210,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":162,"ondisk_log_size":162,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":323,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232128,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":228531,"kb_avail":754742592,"statfs":{"total":773094113280,"available":772856414208,"internally_reserved":0,"allocated":3547136,"data_stored":2139282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":234016306},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":397,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001593"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479195+0000","last_change":"2024-04-25T12:50:12.350119+0000","last_active":"2024-04-25T12:50:54.479195+0000","last_peered":"2024-04-25T12:50:54.479195+0000","last_clean":"2024-04-25T12:50:54.479195+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:50:54.479195+0000","last_undegraded":"2024-04-25T12:50:54.479195+0000","last_fullsized":"2024-04-25T12:50:54.479195+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:49:50.606591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600202+0000","last_change":"2024-04-25T12:50:13.354596+0000","last_active":"2024-04-25T12:50:54.600202+0000","last_peered":"2024-04-25T12:50:54.600202+0000","last_clean":"2024-04-25T12:50:54.600202+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:50:54.600202+0000","last_undegraded":"2024-04-25T12:50:54.600202+0000","last_fullsized":"2024-04-25T12:50:54.600202+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599272+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:54.599272+0000","last_peered":"2024-04-25T12:50:54.599272+0000","last_clean":"2024-04-25T12:50:54.599272+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:54.599272+0000","last_undegraded":"2024-04-25T12:50:54.599272+0000","last_fullsized":"2024-04-25T12:50:54.599272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:52.438134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600386+0000","last_change":"2024-04-25T12:50:12.354034+0000","last_active":"2024-04-25T12:50:54.600386+0000","last_peered":"2024-04-25T12:50:54.600386+0000","last_clean":"2024-04-25T12:50:54.600386+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:50:54.600386+0000","last_undegraded":"2024-04-25T12:50:54.600386+0000","last_fullsized":"2024-04-25T12:50:54.600386+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:32:35.086897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602722+0000","last_change":"2024-04-25T12:50:54.602722+0000","last_active":"2024-04-25T12:50:54.602722+0000","last_peered":"2024-04-25T12:50:54.602722+0000","last_clean":"2024-04-25T12:50:54.602722+0000","last_became_active":"2024-04-25T12:50:54.602420+0000","last_became_peered":"2024-04-25T12:50:54.602420+0000","last_unstale":"2024-04-25T12:50:54.602722+0000","last_undegraded":"2024-04-25T12:50:54.602722+0000","last_fullsized":"2024-04-25T12:50:54.602722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:56.779821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477099+0000","last_change":"2024-04-25T12:50:17.391571+0000","last_active":"2024-04-25T12:50:54.477099+0000","last_peered":"2024-04-25T12:50:54.477099+0000","last_clean":"2024-04-25T12:50:54.477099+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:50:54.477099+0000","last_undegraded":"2024-04-25T12:50:54.477099+0000","last_fullsized":"2024-04-25T12:50:54.477099+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:10.800002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600037+0000","last_change":"2024-04-25T12:50:12.346329+0000","last_active":"2024-04-25T12:50:54.600037+0000","last_peered":"2024-04-25T12:50:54.600037+0000","last_clean":"2024-04-25T12:50:54.600037+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:50:54.600037+0000","last_undegraded":"2024-04-25T12:50:54.600037+0000","last_fullsized":"2024-04-25T12:50:54.600037+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:30:47.055298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479322+0000","last_change":"2024-04-25T12:50:13.361364+0000","last_active":"2024-04-25T12:50:54.479322+0000","last_peered":"2024-04-25T12:50:54.479322+0000","last_clean":"2024-04-25T12:50:54.479322+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:50:54.479322+0000","last_undegraded":"2024-04-25T12:50:54.479322+0000","last_fullsized":"2024-04-25T12:50:54.479322+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:10.899937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477511+0000","last_change":"2024-04-25T12:50:17.390929+0000","last_active":"2024-04-25T12:50:54.477511+0000","last_peered":"2024-04-25T12:50:54.477511+0000","last_clean":"2024-04-25T12:50:54.477511+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:50:54.477511+0000","last_undegraded":"2024-04-25T12:50:54.477511+0000","last_fullsized":"2024-04-25T12:50:54.477511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:13:17.613479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599777+0000","last_change":"2024-04-25T12:50:12.350944+0000","last_active":"2024-04-25T12:50:54.599777+0000","last_peered":"2024-04-25T12:50:54.599777+0000","last_clean":"2024-04-25T12:50:54.599777+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:50:54.599777+0000","last_undegraded":"2024-04-25T12:50:54.599777+0000","last_fullsized":"2024-04-25T12:50:54.599777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:41:49.050350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479735+0000","last_change":"2024-04-25T12:50:13.361669+0000","last_active":"2024-04-25T12:50:54.479735+0000","last_peered":"2024-04-25T12:50:54.479735+0000","last_clean":"2024-04-25T12:50:54.479735+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:50:54.479735+0000","last_undegraded":"2024-04-25T12:50:54.479735+0000","last_fullsized":"2024-04-25T12:50:54.479735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:23.051413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477367+0000","last_change":"2024-04-25T12:50:17.397199+0000","last_active":"2024-04-25T12:50:54.477367+0000","last_peered":"2024-04-25T12:50:54.477367+0000","last_clean":"2024-04-25T12:50:54.477367+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:50:54.477367+0000","last_undegraded":"2024-04-25T12:50:54.477367+0000","last_fullsized":"2024-04-25T12:50:54.477367+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:08:48.902239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474699+0000","last_change":"2024-04-25T12:50:13.356663+0000","last_active":"2024-04-25T12:50:54.474699+0000","last_peered":"2024-04-25T12:50:54.474699+0000","last_clean":"2024-04-25T12:50:54.474699+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:50:54.474699+0000","last_undegraded":"2024-04-25T12:50:54.474699+0000","last_fullsized":"2024-04-25T12:50:54.474699+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:03:59.295589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599849+0000","last_change":"2024-04-25T12:50:12.348739+0000","last_active":"2024-04-25T12:50:54.599849+0000","last_peered":"2024-04-25T12:50:54.599849+0000","last_clean":"2024-04-25T12:50:54.599849+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:50:54.599849+0000","last_undegraded":"2024-04-25T12:50:54.599849+0000","last_fullsized":"2024-04-25T12:50:54.599849+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:43:33.959201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477799+0000","last_change":"2024-04-25T12:50:17.397383+0000","last_active":"2024-04-25T12:50:54.477799+0000","last_peered":"2024-04-25T12:50:54.477799+0000","last_clean":"2024-04-25T12:50:54.477799+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:50:54.477799+0000","last_undegraded":"2024-04-25T12:50:54.477799+0000","last_fullsized":"2024-04-25T12:50:54.477799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:38:13.377993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.361092+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:50:48.523489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600162+0000","last_change":"2024-04-25T12:50:12.356767+0000","last_active":"2024-04-25T12:50:54.600162+0000","last_peered":"2024-04-25T12:50:54.600162+0000","last_clean":"2024-04-25T12:50:54.600162+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:50:54.600162+0000","last_undegraded":"2024-04-25T12:50:54.600162+0000","last_fullsized":"2024-04-25T12:50:54.600162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:05:06.589810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601620+0000","last_change":"2024-04-25T12:50:54.601620+0000","last_active":"2024-04-25T12:50:54.601620+0000","last_peered":"2024-04-25T12:50:54.601620+0000","last_clean":"2024-04-25T12:50:54.601620+0000","last_became_active":"2024-04-25T12:50:54.601163+0000","last_became_peered":"2024-04-25T12:50:54.601163+0000","last_unstale":"2024-04-25T12:50:54.601620+0000","last_undegraded":"2024-04-25T12:50:54.601620+0000","last_fullsized":"2024-04-25T12:50:54.601620+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:11:02.679362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599233+0000","last_change":"2024-04-25T12:50:13.358005+0000","last_active":"2024-04-25T12:50:54.599233+0000","last_peered":"2024-04-25T12:50:54.599233+0000","last_clean":"2024-04-25T12:50:54.599233+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:50:54.599233+0000","last_undegraded":"2024-04-25T12:50:54.599233+0000","last_fullsized":"2024-04-25T12:50:54.599233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:32:38.764175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600288+0000","last_change":"2024-04-25T12:50:12.344454+0000","last_active":"2024-04-25T12:50:54.600288+0000","last_peered":"2024-04-25T12:50:54.600288+0000","last_clean":"2024-04-25T12:50:54.600288+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:50:54.600288+0000","last_undegraded":"2024-04-25T12:50:54.600288+0000","last_fullsized":"2024-04-25T12:50:54.600288+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:13:45.391733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600400+0000","last_change":"2024-04-25T12:50:17.398717+0000","last_active":"2024-04-25T12:50:54.600400+0000","last_peered":"2024-04-25T12:50:54.600400+0000","last_clean":"2024-04-25T12:50:54.600400+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:50:54.600400+0000","last_undegraded":"2024-04-25T12:50:54.600400+0000","last_fullsized":"2024-04-25T12:50:54.600400+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:32.746957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478229+0000","last_change":"2024-04-25T12:50:13.359769+0000","last_active":"2024-04-25T12:50:54.478229+0000","last_peered":"2024-04-25T12:50:54.478229+0000","last_clean":"2024-04-25T12:50:54.478229+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:50:54.478229+0000","last_undegraded":"2024-04-25T12:50:54.478229+0000","last_fullsized":"2024-04-25T12:50:54.478229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599368+0000","last_change":"2024-04-25T12:50:12.352056+0000","last_active":"2024-04-25T12:50:54.599368+0000","last_peered":"2024-04-25T12:50:54.599368+0000","last_clean":"2024-04-25T12:50:54.599368+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:50:54.599368+0000","last_undegraded":"2024-04-25T12:50:54.599368+0000","last_fullsized":"2024-04-25T12:50:54.599368+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:16:52.830821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478354+0000","last_change":"2024-04-25T12:50:17.392737+0000","last_active":"2024-04-25T12:50:54.478354+0000","last_peered":"2024-04-25T12:50:54.478354+0000","last_clean":"2024-04-25T12:50:54.478354+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:50:54.478354+0000","last_undegraded":"2024-04-25T12:50:54.478354+0000","last_fullsized":"2024-04-25T12:50:54.478354+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:46:09.746109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478968+0000","last_change":"2024-04-25T12:50:13.358934+0000","last_active":"2024-04-25T12:50:54.478968+0000","last_peered":"2024-04-25T12:50:54.478968+0000","last_clean":"2024-04-25T12:50:54.478968+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:50:54.478968+0000","last_undegraded":"2024-04-25T12:50:54.478968+0000","last_fullsized":"2024-04-25T12:50:54.478968+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:25.882045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475142+0000","last_change":"2024-04-25T12:50:12.347453+0000","last_active":"2024-04-25T12:50:54.475142+0000","last_peered":"2024-04-25T12:50:54.475142+0000","last_clean":"2024-04-25T12:50:54.475142+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:50:54.475142+0000","last_undegraded":"2024-04-25T12:50:54.475142+0000","last_fullsized":"2024-04-25T12:50:54.475142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:09:29.583052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478073+0000","last_change":"2024-04-25T12:50:17.399240+0000","last_active":"2024-04-25T12:50:54.478073+0000","last_peered":"2024-04-25T12:50:54.478073+0000","last_clean":"2024-04-25T12:50:54.478073+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:50:54.478073+0000","last_undegraded":"2024-04-25T12:50:54.478073+0000","last_fullsized":"2024-04-25T12:50:54.478073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:57:09.497401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600661+0000","last_change":"2024-04-25T12:50:13.360823+0000","last_active":"2024-04-25T12:50:54.600661+0000","last_peered":"2024-04-25T12:50:54.600661+0000","last_clean":"2024-04-25T12:50:54.600661+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:50:54.600661+0000","last_undegraded":"2024-04-25T12:50:54.600661+0000","last_fullsized":"2024-04-25T12:50:54.600661+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600151+0000","last_change":"2024-04-25T12:50:12.344217+0000","last_active":"2024-04-25T12:50:54.600151+0000","last_peered":"2024-04-25T12:50:54.600151+0000","last_clean":"2024-04-25T12:50:54.600151+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:50:54.600151+0000","last_undegraded":"2024-04-25T12:50:54.600151+0000","last_fullsized":"2024-04-25T12:50:54.600151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:12:21.674463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.598907+0000","last_change":"2024-04-25T12:50:17.395655+0000","last_active":"2024-04-25T12:50:54.598907+0000","last_peered":"2024-04-25T12:50:54.598907+0000","last_clean":"2024-04-25T12:50:54.598907+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:50:54.598907+0000","last_undegraded":"2024-04-25T12:50:54.598907+0000","last_fullsized":"2024-04-25T12:50:54.598907+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:48:44.140886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600154+0000","last_change":"2024-04-25T12:50:13.356336+0000","last_active":"2024-04-25T12:50:54.600154+0000","last_peered":"2024-04-25T12:50:54.600154+0000","last_clean":"2024-04-25T12:50:54.600154+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:50:54.600154+0000","last_undegraded":"2024-04-25T12:50:54.600154+0000","last_fullsized":"2024-04-25T12:50:54.600154+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:01:11.602186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600170+0000","last_change":"2024-04-25T12:50:12.351999+0000","last_active":"2024-04-25T12:50:54.600170+0000","last_peered":"2024-04-25T12:50:54.600170+0000","last_clean":"2024-04-25T12:50:54.600170+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:50:54.600170+0000","last_undegraded":"2024-04-25T12:50:54.600170+0000","last_fullsized":"2024-04-25T12:50:54.600170+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:06:40.056305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478601+0000","last_change":"2024-04-25T12:50:17.399743+0000","last_active":"2024-04-25T12:50:54.478601+0000","last_peered":"2024-04-25T12:50:54.478601+0000","last_clean":"2024-04-25T12:50:54.478601+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:50:54.478601+0000","last_undegraded":"2024-04-25T12:50:54.478601+0000","last_fullsized":"2024-04-25T12:50:54.478601+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:53:34.023675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480012+0000","last_change":"2024-04-25T12:50:13.362645+0000","last_active":"2024-04-25T12:50:54.480012+0000","last_peered":"2024-04-25T12:50:54.480012+0000","last_clean":"2024-04-25T12:50:54.480012+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:50:54.480012+0000","last_undegraded":"2024-04-25T12:50:54.480012+0000","last_fullsized":"2024-04-25T12:50:54.480012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:43.268446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600254+0000","last_change":"2024-04-25T12:50:12.343510+0000","last_active":"2024-04-25T12:50:54.600254+0000","last_peered":"2024-04-25T12:50:54.600254+0000","last_clean":"2024-04-25T12:50:54.600254+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:50:54.600254+0000","last_undegraded":"2024-04-25T12:50:54.600254+0000","last_fullsized":"2024-04-25T12:50:54.600254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:23:38.939746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599823+0000","last_change":"2024-04-25T12:50:17.395533+0000","last_active":"2024-04-25T12:50:54.599823+0000","last_peered":"2024-04-25T12:50:54.599823+0000","last_clean":"2024-04-25T12:50:54.599823+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:50:54.599823+0000","last_undegraded":"2024-04-25T12:50:54.599823+0000","last_fullsized":"2024-04-25T12:50:54.599823+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:52:59.177871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477890+0000","last_change":"2024-04-25T12:50:13.359172+0000","last_active":"2024-04-25T12:50:54.477890+0000","last_peered":"2024-04-25T12:50:54.477890+0000","last_clean":"2024-04-25T12:50:54.477890+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:50:54.477890+0000","last_undegraded":"2024-04-25T12:50:54.477890+0000","last_fullsized":"2024-04-25T12:50:54.477890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:35:21.502376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479691+0000","last_change":"2024-04-25T12:50:12.352007+0000","last_active":"2024-04-25T12:50:54.479691+0000","last_peered":"2024-04-25T12:50:54.479691+0000","last_clean":"2024-04-25T12:50:54.479691+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:50:54.479691+0000","last_undegraded":"2024-04-25T12:50:54.479691+0000","last_fullsized":"2024-04-25T12:50:54.479691+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:31:25.475547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599847+0000","last_change":"2024-04-25T12:50:17.394092+0000","last_active":"2024-04-25T12:50:54.599847+0000","last_peered":"2024-04-25T12:50:54.599847+0000","last_clean":"2024-04-25T12:50:54.599847+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:50:54.599847+0000","last_undegraded":"2024-04-25T12:50:54.599847+0000","last_fullsized":"2024-04-25T12:50:54.599847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:04.430091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599531+0000","last_change":"2024-04-25T12:50:13.356806+0000","last_active":"2024-04-25T12:50:54.599531+0000","last_peered":"2024-04-25T12:50:54.599531+0000","last_clean":"2024-04-25T12:50:54.599531+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:50:54.599531+0000","last_undegraded":"2024-04-25T12:50:54.599531+0000","last_fullsized":"2024-04-25T12:50:54.599531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:32.473455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476542+0000","last_change":"2024-04-25T12:50:12.355224+0000","last_active":"2024-04-25T12:50:54.476542+0000","last_peered":"2024-04-25T12:50:54.476542+0000","last_clean":"2024-04-25T12:50:54.476542+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:50:54.476542+0000","last_undegraded":"2024-04-25T12:50:54.476542+0000","last_fullsized":"2024-04-25T12:50:54.476542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:01:57.533942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600495+0000","last_change":"2024-04-25T12:50:17.396046+0000","last_active":"2024-04-25T12:50:54.600495+0000","last_peered":"2024-04-25T12:50:54.600495+0000","last_clean":"2024-04-25T12:50:54.600495+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:50:54.600495+0000","last_undegraded":"2024-04-25T12:50:54.600495+0000","last_fullsized":"2024-04-25T12:50:54.600495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:12:06.650433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478363+0000","last_change":"2024-04-25T12:50:13.364912+0000","last_active":"2024-04-25T12:50:54.478363+0000","last_peered":"2024-04-25T12:50:54.478363+0000","last_clean":"2024-04-25T12:50:54.478363+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:50:54.478363+0000","last_undegraded":"2024-04-25T12:50:54.478363+0000","last_fullsized":"2024-04-25T12:50:54.478363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:32:42.037157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599446+0000","last_change":"2024-04-25T12:50:12.346563+0000","last_active":"2024-04-25T12:50:54.599446+0000","last_peered":"2024-04-25T12:50:54.599446+0000","last_clean":"2024-04-25T12:50:54.599446+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:50:54.599446+0000","last_undegraded":"2024-04-25T12:50:54.599446+0000","last_fullsized":"2024-04-25T12:50:54.599446+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:53.382730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.601447+0000","last_change":"2024-04-25T12:50:54.601447+0000","last_active":"2024-04-25T12:50:54.601447+0000","last_peered":"2024-04-25T12:50:54.601447+0000","last_clean":"2024-04-25T12:50:54.601447+0000","last_became_active":"2024-04-25T12:50:54.601056+0000","last_became_peered":"2024-04-25T12:50:54.601056+0000","last_unstale":"2024-04-25T12:50:54.601447+0000","last_undegraded":"2024-04-25T12:50:54.601447+0000","last_fullsized":"2024-04-25T12:50:54.601447+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:14:00.221828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599271+0000","last_change":"2024-04-25T12:50:13.363336+0000","last_active":"2024-04-25T12:50:54.599271+0000","last_peered":"2024-04-25T12:50:54.599271+0000","last_clean":"2024-04-25T12:50:54.599271+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:50:54.599271+0000","last_undegraded":"2024-04-25T12:50:54.599271+0000","last_fullsized":"2024-04-25T12:50:54.599271+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:52:04.199913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479375+0000","last_change":"2024-04-25T12:50:12.350447+0000","last_active":"2024-04-25T12:50:54.479375+0000","last_peered":"2024-04-25T12:50:54.479375+0000","last_clean":"2024-04-25T12:50:54.479375+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:50:54.479375+0000","last_undegraded":"2024-04-25T12:50:54.479375+0000","last_fullsized":"2024-04-25T12:50:54.479375+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:37:00.120240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599510+0000","last_change":"2024-04-25T12:50:02.342705+0000","last_active":"2024-04-25T12:50:54.599510+0000","last_peered":"2024-04-25T12:50:54.599510+0000","last_clean":"2024-04-25T12:50:54.599510+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:50:54.599510+0000","last_undegraded":"2024-04-25T12:50:54.599510+0000","last_fullsized":"2024-04-25T12:50:54.599510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:01.294396+0000","last_clean_scrub_stamp":"2024-04-25T12:50:01.294396+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:50:20.541653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474978+0000","last_change":"2024-04-25T12:50:17.398700+0000","last_active":"2024-04-25T12:50:54.474978+0000","last_peered":"2024-04-25T12:50:54.474978+0000","last_clean":"2024-04-25T12:50:54.474978+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:50:54.474978+0000","last_undegraded":"2024-04-25T12:50:54.474978+0000","last_fullsized":"2024-04-25T12:50:54.474978+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599883+0000","last_change":"2024-04-25T12:50:13.370158+0000","last_active":"2024-04-25T12:50:54.599883+0000","last_peered":"2024-04-25T12:50:54.599883+0000","last_clean":"2024-04-25T12:50:54.599883+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:50:54.599883+0000","last_undegraded":"2024-04-25T12:50:54.599883+0000","last_fullsized":"2024-04-25T12:50:54.599883+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:44:32.840123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:12.346553+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:49:34.527501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474733+0000","last_change":"2024-04-25T12:50:17.399080+0000","last_active":"2024-04-25T12:50:54.474733+0000","last_peered":"2024-04-25T12:50:54.474733+0000","last_clean":"2024-04-25T12:50:54.474733+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:50:54.474733+0000","last_undegraded":"2024-04-25T12:50:54.474733+0000","last_fullsized":"2024-04-25T12:50:54.474733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479406+0000","last_change":"2024-04-25T12:50:13.362886+0000","last_active":"2024-04-25T12:50:54.479406+0000","last_peered":"2024-04-25T12:50:54.479406+0000","last_clean":"2024-04-25T12:50:54.479406+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:50:54.479406+0000","last_undegraded":"2024-04-25T12:50:54.479406+0000","last_fullsized":"2024-04-25T12:50:54.479406+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:43.749590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599921+0000","last_change":"2024-04-25T12:50:12.348946+0000","last_active":"2024-04-25T12:50:54.599921+0000","last_peered":"2024-04-25T12:50:54.599921+0000","last_clean":"2024-04-25T12:50:54.599921+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:50:54.599921+0000","last_undegraded":"2024-04-25T12:50:54.599921+0000","last_fullsized":"2024-04-25T12:50:54.599921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:19:37.610470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478719+0000","last_change":"2024-04-25T12:50:17.395285+0000","last_active":"2024-04-25T12:50:54.478719+0000","last_peered":"2024-04-25T12:50:54.478719+0000","last_clean":"2024-04-25T12:50:54.478719+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:50:54.478719+0000","last_undegraded":"2024-04-25T12:50:54.478719+0000","last_fullsized":"2024-04-25T12:50:54.478719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:49.108766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600500+0000","last_change":"2024-04-25T12:50:13.366739+0000","last_active":"2024-04-25T12:50:54.600500+0000","last_peered":"2024-04-25T12:50:54.600500+0000","last_clean":"2024-04-25T12:50:54.600500+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:50:54.600500+0000","last_undegraded":"2024-04-25T12:50:54.600500+0000","last_fullsized":"2024-04-25T12:50:54.600500+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:30:21.522600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476341+0000","last_change":"2024-04-25T12:50:12.354325+0000","last_active":"2024-04-25T12:50:54.476341+0000","last_peered":"2024-04-25T12:50:54.476341+0000","last_clean":"2024-04-25T12:50:54.476341+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:50:54.476341+0000","last_undegraded":"2024-04-25T12:50:54.476341+0000","last_fullsized":"2024-04-25T12:50:54.476341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:02:09.089203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478904+0000","last_change":"2024-04-25T12:50:17.400502+0000","last_active":"2024-04-25T12:50:54.478904+0000","last_peered":"2024-04-25T12:50:54.478904+0000","last_clean":"2024-04-25T12:50:54.478904+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:50:54.478904+0000","last_undegraded":"2024-04-25T12:50:54.478904+0000","last_fullsized":"2024-04-25T12:50:54.478904+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:40:42.669183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600300+0000","last_change":"2024-04-25T12:50:13.368018+0000","last_active":"2024-04-25T12:50:54.600300+0000","last_peered":"2024-04-25T12:50:54.600300+0000","last_clean":"2024-04-25T12:50:54.600300+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:50:54.600300+0000","last_undegraded":"2024-04-25T12:50:54.600300+0000","last_fullsized":"2024-04-25T12:50:54.600300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:08:13.604539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478701+0000","last_change":"2024-04-25T12:50:12.342908+0000","last_active":"2024-04-25T12:50:54.478701+0000","last_peered":"2024-04-25T12:50:54.478701+0000","last_clean":"2024-04-25T12:50:54.478701+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:50:54.478701+0000","last_undegraded":"2024-04-25T12:50:54.478701+0000","last_fullsized":"2024-04-25T12:50:54.478701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:00.945600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.602094+0000","last_change":"2024-04-25T12:50:54.602094+0000","last_active":"2024-04-25T12:50:54.602094+0000","last_peered":"2024-04-25T12:50:54.602094+0000","last_clean":"2024-04-25T12:50:54.602094+0000","last_became_active":"2024-04-25T12:50:54.601336+0000","last_became_peered":"2024-04-25T12:50:54.601336+0000","last_unstale":"2024-04-25T12:50:54.602094+0000","last_undegraded":"2024-04-25T12:50:54.602094+0000","last_fullsized":"2024-04-25T12:50:54.602094+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:21:50.002160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.483087+0000","last_change":"2024-04-25T12:50:54.479164+0000","last_active":"2024-04-25T12:50:54.483087+0000","last_peered":"2024-04-25T12:50:54.483087+0000","last_clean":"2024-04-25T12:50:54.483087+0000","last_became_active":"2024-04-25T12:50:54.478889+0000","last_became_peered":"2024-04-25T12:50:54.478889+0000","last_unstale":"2024-04-25T12:50:54.483087+0000","last_undegraded":"2024-04-25T12:50:54.483087+0000","last_fullsized":"2024-04-25T12:50:54.483087+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:51.351035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475987+0000","last_change":"2024-04-25T12:50:12.343745+0000","last_active":"2024-04-25T12:50:54.475987+0000","last_peered":"2024-04-25T12:50:54.475987+0000","last_clean":"2024-04-25T12:50:54.475987+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:50:54.475987+0000","last_undegraded":"2024-04-25T12:50:54.475987+0000","last_fullsized":"2024-04-25T12:50:54.475987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:18:54.749896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478799+0000","last_change":"2024-04-25T12:50:17.400431+0000","last_active":"2024-04-25T12:50:54.478799+0000","last_peered":"2024-04-25T12:50:54.478799+0000","last_clean":"2024-04-25T12:50:54.478799+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:50:54.478799+0000","last_undegraded":"2024-04-25T12:50:54.478799+0000","last_fullsized":"2024-04-25T12:50:54.478799+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:25:49.992438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474617+0000","last_change":"2024-04-25T12:50:13.366685+0000","last_active":"2024-04-25T12:50:54.474617+0000","last_peered":"2024-04-25T12:50:54.474617+0000","last_clean":"2024-04-25T12:50:54.474617+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:50:54.474617+0000","last_undegraded":"2024-04-25T12:50:54.474617+0000","last_fullsized":"2024-04-25T12:50:54.474617+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:23:25.830757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474706+0000","last_change":"2024-04-25T12:50:12.348190+0000","last_active":"2024-04-25T12:50:54.474706+0000","last_peered":"2024-04-25T12:50:54.474706+0000","last_clean":"2024-04-25T12:50:54.474706+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:50:54.474706+0000","last_undegraded":"2024-04-25T12:50:54.474706+0000","last_fullsized":"2024-04-25T12:50:54.474706+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:00.156011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600491+0000","last_change":"2024-04-25T12:50:17.399293+0000","last_active":"2024-04-25T12:50:54.600491+0000","last_peered":"2024-04-25T12:50:54.600491+0000","last_clean":"2024-04-25T12:50:54.600491+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:50:54.600491+0000","last_undegraded":"2024-04-25T12:50:54.600491+0000","last_fullsized":"2024-04-25T12:50:54.600491+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:06:18.260629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599852+0000","last_change":"2024-04-25T12:50:13.366059+0000","last_active":"2024-04-25T12:50:54.599852+0000","last_peered":"2024-04-25T12:50:54.599852+0000","last_clean":"2024-04-25T12:50:54.599852+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:50:54.599852+0000","last_undegraded":"2024-04-25T12:50:54.599852+0000","last_fullsized":"2024-04-25T12:50:54.599852+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:23.105688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479586+0000","last_change":"2024-04-25T12:50:12.356549+0000","last_active":"2024-04-25T12:50:54.479586+0000","last_peered":"2024-04-25T12:50:54.479586+0000","last_clean":"2024-04-25T12:50:54.479586+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:50:54.479586+0000","last_undegraded":"2024-04-25T12:50:54.479586+0000","last_fullsized":"2024-04-25T12:50:54.479586+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:16:46.726819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599324+0000","last_change":"2024-04-25T12:50:17.396939+0000","last_active":"2024-04-25T12:50:54.599324+0000","last_peered":"2024-04-25T12:50:54.599324+0000","last_clean":"2024-04-25T12:50:54.599324+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:50:54.599324+0000","last_undegraded":"2024-04-25T12:50:54.599324+0000","last_fullsized":"2024-04-25T12:50:54.599324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:08.372574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478503+0000","last_change":"2024-04-25T12:50:13.363259+0000","last_active":"2024-04-25T12:50:54.478503+0000","last_peered":"2024-04-25T12:50:54.478503+0000","last_clean":"2024-04-25T12:50:54.478503+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:50:54.478503+0000","last_undegraded":"2024-04-25T12:50:54.478503+0000","last_fullsized":"2024-04-25T12:50:54.478503+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:26.305803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478971+0000","last_change":"2024-04-25T12:50:12.348169+0000","last_active":"2024-04-25T12:50:54.478971+0000","last_peered":"2024-04-25T12:50:54.478971+0000","last_clean":"2024-04-25T12:50:54.478971+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:50:54.478971+0000","last_undegraded":"2024-04-25T12:50:54.478971+0000","last_fullsized":"2024-04-25T12:50:54.478971+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:28.569497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479694+0000","last_change":"2024-04-25T12:50:17.400294+0000","last_active":"2024-04-25T12:50:54.479694+0000","last_peered":"2024-04-25T12:50:54.479694+0000","last_clean":"2024-04-25T12:50:54.479694+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:50:54.479694+0000","last_undegraded":"2024-04-25T12:50:54.479694+0000","last_fullsized":"2024-04-25T12:50:54.479694+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:39:36.211744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599802+0000","last_change":"2024-04-25T12:50:13.370172+0000","last_active":"2024-04-25T12:50:54.599802+0000","last_peered":"2024-04-25T12:50:54.599802+0000","last_clean":"2024-04-25T12:50:54.599802+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:50:54.599802+0000","last_undegraded":"2024-04-25T12:50:54.599802+0000","last_fullsized":"2024-04-25T12:50:54.599802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:20:31.946329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475360+0000","last_change":"2024-04-25T12:50:12.354391+0000","last_active":"2024-04-25T12:50:54.475360+0000","last_peered":"2024-04-25T12:50:54.475360+0000","last_clean":"2024-04-25T12:50:54.475360+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:50:54.475360+0000","last_undegraded":"2024-04-25T12:50:54.475360+0000","last_fullsized":"2024-04-25T12:50:54.475360+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:43:41.678417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599973+0000","last_change":"2024-04-25T12:50:17.395551+0000","last_active":"2024-04-25T12:50:54.599973+0000","last_peered":"2024-04-25T12:50:54.599973+0000","last_clean":"2024-04-25T12:50:54.599973+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:50:54.599973+0000","last_undegraded":"2024-04-25T12:50:54.599973+0000","last_fullsized":"2024-04-25T12:50:54.599973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:23:29.597723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477988+0000","last_change":"2024-04-25T12:50:13.361904+0000","last_active":"2024-04-25T12:50:54.477988+0000","last_peered":"2024-04-25T12:50:54.477988+0000","last_clean":"2024-04-25T12:50:54.477988+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:50:54.477988+0000","last_undegraded":"2024-04-25T12:50:54.477988+0000","last_fullsized":"2024-04-25T12:50:54.477988+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:29:04.067366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599804+0000","last_change":"2024-04-25T12:50:12.347395+0000","last_active":"2024-04-25T12:50:54.599804+0000","last_peered":"2024-04-25T12:50:54.599804+0000","last_clean":"2024-04-25T12:50:54.599804+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:50:54.599804+0000","last_undegraded":"2024-04-25T12:50:54.599804+0000","last_fullsized":"2024-04-25T12:50:54.599804+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:52:19.281036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477578+0000","last_change":"2024-04-25T12:50:17.387341+0000","last_active":"2024-04-25T12:50:54.477578+0000","last_peered":"2024-04-25T12:50:54.477578+0000","last_clean":"2024-04-25T12:50:54.477578+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:50:54.477578+0000","last_undegraded":"2024-04-25T12:50:54.477578+0000","last_fullsized":"2024-04-25T12:50:54.477578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:09:58.140183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479101+0000","last_change":"2024-04-25T12:50:13.364150+0000","last_active":"2024-04-25T12:50:54.479101+0000","last_peered":"2024-04-25T12:50:54.479101+0000","last_clean":"2024-04-25T12:50:54.479101+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:50:54.479101+0000","last_undegraded":"2024-04-25T12:50:54.479101+0000","last_fullsized":"2024-04-25T12:50:54.479101+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:30:49.744061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480204+0000","last_change":"2024-04-25T12:50:12.351102+0000","last_active":"2024-04-25T12:50:54.480204+0000","last_peered":"2024-04-25T12:50:54.480204+0000","last_clean":"2024-04-25T12:50:54.480204+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:50:54.480204+0000","last_undegraded":"2024-04-25T12:50:54.480204+0000","last_fullsized":"2024-04-25T12:50:54.480204+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:10:13.228202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599114+0000","last_change":"2024-04-25T12:50:17.387531+0000","last_active":"2024-04-25T12:50:54.599114+0000","last_peered":"2024-04-25T12:50:54.599114+0000","last_clean":"2024-04-25T12:50:54.599114+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:50:54.599114+0000","last_undegraded":"2024-04-25T12:50:54.599114+0000","last_fullsized":"2024-04-25T12:50:54.599114+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:06.489506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480208+0000","last_change":"2024-04-25T12:50:13.370024+0000","last_active":"2024-04-25T12:50:54.480208+0000","last_peered":"2024-04-25T12:50:54.480208+0000","last_clean":"2024-04-25T12:50:54.480208+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:50:54.480208+0000","last_undegraded":"2024-04-25T12:50:54.480208+0000","last_fullsized":"2024-04-25T12:50:54.480208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:16:37.916020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:12.350246+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:58:05.848506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599573+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:54.599573+0000","last_peered":"2024-04-25T12:50:54.599573+0000","last_clean":"2024-04-25T12:50:54.599573+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:54.599573+0000","last_undegraded":"2024-04-25T12:50:54.599573+0000","last_fullsized":"2024-04-25T12:50:54.599573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:43:56.835648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478848+0000","last_change":"2024-04-25T12:50:17.402312+0000","last_active":"2024-04-25T12:50:54.478848+0000","last_peered":"2024-04-25T12:50:54.478848+0000","last_clean":"2024-04-25T12:50:54.478848+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:50:54.478848+0000","last_undegraded":"2024-04-25T12:50:54.478848+0000","last_fullsized":"2024-04-25T12:50:54.478848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:52:15.450179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599456+0000","last_change":"2024-04-25T12:50:13.355697+0000","last_active":"2024-04-25T12:50:54.599456+0000","last_peered":"2024-04-25T12:50:54.599456+0000","last_clean":"2024-04-25T12:50:54.599456+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:50:54.599456+0000","last_undegraded":"2024-04-25T12:50:54.599456+0000","last_fullsized":"2024-04-25T12:50:54.599456+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:38:04.009506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479149+0000","last_change":"2024-04-25T12:50:12.353498+0000","last_active":"2024-04-25T12:50:54.479149+0000","last_peered":"2024-04-25T12:50:54.479149+0000","last_clean":"2024-04-25T12:50:54.479149+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:50:54.479149+0000","last_undegraded":"2024-04-25T12:50:54.479149+0000","last_fullsized":"2024-04-25T12:50:54.479149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:52.439991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474875+0000","last_change":"2024-04-25T12:50:17.395563+0000","last_active":"2024-04-25T12:50:54.474875+0000","last_peered":"2024-04-25T12:50:54.474875+0000","last_clean":"2024-04-25T12:50:54.474875+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:50:54.474875+0000","last_undegraded":"2024-04-25T12:50:54.474875+0000","last_fullsized":"2024-04-25T12:50:54.474875+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:07:48.389837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599136+0000","last_change":"2024-04-25T12:50:13.360449+0000","last_active":"2024-04-25T12:50:54.599136+0000","last_peered":"2024-04-25T12:50:54.599136+0000","last_clean":"2024-04-25T12:50:54.599136+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:50:54.599136+0000","last_undegraded":"2024-04-25T12:50:54.599136+0000","last_fullsized":"2024-04-25T12:50:54.599136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":26,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599786+0000","last_change":"2024-04-25T12:50:12.354074+0000","last_active":"2024-04-25T12:50:54.599786+0000","last_peered":"2024-04-25T12:50:54.599786+0000","last_clean":"2024-04-25T12:50:54.599786+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:50:54.599786+0000","last_undegraded":"2024-04-25T12:50:54.599786+0000","last_fullsized":"2024-04-25T12:50:54.599786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:14:57.635543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474954+0000","last_change":"2024-04-25T12:50:12.348369+0000","last_active":"2024-04-25T12:50:54.474954+0000","last_peered":"2024-04-25T12:50:54.474954+0000","last_clean":"2024-04-25T12:50:54.474954+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:50:54.474954+0000","last_undegraded":"2024-04-25T12:50:54.474954+0000","last_fullsized":"2024-04-25T12:50:54.474954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:42:25.139000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478999+0000","last_change":"2024-04-25T12:50:13.359272+0000","last_active":"2024-04-25T12:50:54.478999+0000","last_peered":"2024-04-25T12:50:54.478999+0000","last_clean":"2024-04-25T12:50:54.478999+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:50:54.478999+0000","last_undegraded":"2024-04-25T12:50:54.478999+0000","last_fullsized":"2024-04-25T12:50:54.478999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:47.976486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476107+0000","last_change":"2024-04-25T12:50:17.391715+0000","last_active":"2024-04-25T12:50:54.476107+0000","last_peered":"2024-04-25T12:50:54.476107+0000","last_clean":"2024-04-25T12:50:54.476107+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:50:54.476107+0000","last_undegraded":"2024-04-25T12:50:54.476107+0000","last_fullsized":"2024-04-25T12:50:54.476107+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:25:43.997839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599639+0000","last_change":"2024-04-25T12:50:12.354462+0000","last_active":"2024-04-25T12:50:54.599639+0000","last_peered":"2024-04-25T12:50:54.599639+0000","last_clean":"2024-04-25T12:50:54.599639+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:50:54.599639+0000","last_undegraded":"2024-04-25T12:50:54.599639+0000","last_fullsized":"2024-04-25T12:50:54.599639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:11.320473+0000","last_clean_scrub_stamp":"2024-04-25T12:50:11.320473+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:13:48.546129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478180+0000","last_change":"2024-04-25T12:50:13.359298+0000","last_active":"2024-04-25T12:50:54.478180+0000","last_peered":"2024-04-25T12:50:54.478180+0000","last_clean":"2024-04-25T12:50:54.478180+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:50:54.478180+0000","last_undegraded":"2024-04-25T12:50:54.478180+0000","last_fullsized":"2024-04-25T12:50:54.478180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:55:24.618710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":18,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600139+0000","last_change":"2024-04-25T12:50:17.393418+0000","last_active":"2024-04-25T12:50:54.600139+0000","last_peered":"2024-04-25T12:50:54.600139+0000","last_clean":"2024-04-25T12:50:54.600139+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:50:54.600139+0000","last_undegraded":"2024-04-25T12:50:54.600139+0000","last_fullsized":"2024-04-25T12:50:54.600139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:30:56.381811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.474510+0000","last_change":"2024-04-25T12:50:13.366461+0000","last_active":"2024-04-25T12:50:54.474510+0000","last_peered":"2024-04-25T12:50:54.474510+0000","last_clean":"2024-04-25T12:50:54.474510+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:50:54.474510+0000","last_undegraded":"2024-04-25T12:50:54.474510+0000","last_fullsized":"2024-04-25T12:50:54.474510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:56:55.868285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475994+0000","last_change":"2024-04-25T12:50:13.363074+0000","last_active":"2024-04-25T12:50:54.475994+0000","last_peered":"2024-04-25T12:50:54.475994+0000","last_clean":"2024-04-25T12:50:54.475994+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:50:54.475994+0000","last_undegraded":"2024-04-25T12:50:54.475994+0000","last_fullsized":"2024-04-25T12:50:54.475994+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:51:02.998625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.603199+0000","last_change":"2024-04-25T12:50:54.603199+0000","last_active":"2024-04-25T12:50:54.603199+0000","last_peered":"2024-04-25T12:50:54.603199+0000","last_clean":"2024-04-25T12:50:54.603199+0000","last_became_active":"2024-04-25T12:50:54.602588+0000","last_became_peered":"2024-04-25T12:50:54.602588+0000","last_unstale":"2024-04-25T12:50:54.603199+0000","last_undegraded":"2024-04-25T12:50:54.603199+0000","last_fullsized":"2024-04-25T12:50:54.603199+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:41:24.120485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478768+0000","last_change":"2024-04-25T12:50:13.359246+0000","last_active":"2024-04-25T12:50:54.478768+0000","last_peered":"2024-04-25T12:50:54.478768+0000","last_clean":"2024-04-25T12:50:54.478768+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:50:54.478768+0000","last_undegraded":"2024-04-25T12:50:54.478768+0000","last_fullsized":"2024-04-25T12:50:54.478768+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:03:15.288066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599589+0000","last_change":"2024-04-25T12:50:13.356415+0000","last_active":"2024-04-25T12:50:54.599589+0000","last_peered":"2024-04-25T12:50:54.599589+0000","last_clean":"2024-04-25T12:50:54.599589+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:50:54.599589+0000","last_undegraded":"2024-04-25T12:50:54.599589+0000","last_fullsized":"2024-04-25T12:50:54.599589+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:45:26.419161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599658+0000","last_change":"2024-04-25T12:50:13.354979+0000","last_active":"2024-04-25T12:50:54.599658+0000","last_peered":"2024-04-25T12:50:54.599658+0000","last_clean":"2024-04-25T12:50:54.599658+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:50:54.599658+0000","last_undegraded":"2024-04-25T12:50:54.599658+0000","last_fullsized":"2024-04-25T12:50:54.599658+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:45:55.773340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475338+0000","last_change":"2024-04-25T12:50:13.363018+0000","last_active":"2024-04-25T12:50:54.475338+0000","last_peered":"2024-04-25T12:50:54.475338+0000","last_clean":"2024-04-25T12:50:54.475338+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:50:54.475338+0000","last_undegraded":"2024-04-25T12:50:54.475338+0000","last_fullsized":"2024-04-25T12:50:54.475338+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:11:46.343389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600579+0000","last_change":"2024-04-25T12:50:13.358746+0000","last_active":"2024-04-25T12:50:54.600579+0000","last_peered":"2024-04-25T12:50:54.600579+0000","last_clean":"2024-04-25T12:50:54.600579+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:50:54.600579+0000","last_undegraded":"2024-04-25T12:50:54.600579+0000","last_fullsized":"2024-04-25T12:50:54.600579+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:44:47.249476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479039+0000","last_change":"2024-04-25T12:50:13.363567+0000","last_active":"2024-04-25T12:50:54.479039+0000","last_peered":"2024-04-25T12:50:54.479039+0000","last_clean":"2024-04-25T12:50:54.479039+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:50:54.479039+0000","last_undegraded":"2024-04-25T12:50:54.479039+0000","last_fullsized":"2024-04-25T12:50:54.479039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:43:29.094633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599703+0000","last_change":"2024-04-25T12:50:13.365007+0000","last_active":"2024-04-25T12:50:54.599703+0000","last_peered":"2024-04-25T12:50:54.599703+0000","last_clean":"2024-04-25T12:50:54.599703+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:50:54.599703+0000","last_undegraded":"2024-04-25T12:50:54.599703+0000","last_fullsized":"2024-04-25T12:50:54.599703+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:44.955600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.604906+0000","last_change":"2024-04-25T12:50:54.600889+0000","last_active":"2024-04-25T12:50:54.604906+0000","last_peered":"2024-04-25T12:50:54.604906+0000","last_clean":"2024-04-25T12:50:54.604906+0000","last_became_active":"2024-04-25T12:50:54.600590+0000","last_became_peered":"2024-04-25T12:50:54.600590+0000","last_unstale":"2024-04-25T12:50:54.604906+0000","last_undegraded":"2024-04-25T12:50:54.604906+0000","last_fullsized":"2024-04-25T12:50:54.604906+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:35.493159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478655+0000","last_change":"2024-04-25T12:50:13.365765+0000","last_active":"2024-04-25T12:50:54.478655+0000","last_peered":"2024-04-25T12:50:54.478655+0000","last_clean":"2024-04-25T12:50:54.478655+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:50:54.478655+0000","last_undegraded":"2024-04-25T12:50:54.478655+0000","last_fullsized":"2024-04-25T12:50:54.478655+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:38.160506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475148+0000","last_change":"2024-04-25T12:50:13.357455+0000","last_active":"2024-04-25T12:50:54.475148+0000","last_peered":"2024-04-25T12:50:54.475148+0000","last_clean":"2024-04-25T12:50:54.475148+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:50:54.475148+0000","last_undegraded":"2024-04-25T12:50:54.475148+0000","last_fullsized":"2024-04-25T12:50:54.475148+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:40:01.466736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600079+0000","last_change":"2024-04-25T12:50:13.365814+0000","last_active":"2024-04-25T12:50:54.600079+0000","last_peered":"2024-04-25T12:50:54.600079+0000","last_clean":"2024-04-25T12:50:54.600079+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:50:54.600079+0000","last_undegraded":"2024-04-25T12:50:54.600079+0000","last_fullsized":"2024-04-25T12:50:54.600079+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:30:25.340770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.476311+0000","last_change":"2024-04-25T12:50:13.352431+0000","last_active":"2024-04-25T12:50:54.476311+0000","last_peered":"2024-04-25T12:50:54.476311+0000","last_clean":"2024-04-25T12:50:54.476311+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:50:54.476311+0000","last_undegraded":"2024-04-25T12:50:54.476311+0000","last_fullsized":"2024-04-25T12:50:54.476311+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:17:43.062372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.480451+0000","last_change":"2024-04-25T12:50:13.369414+0000","last_active":"2024-04-25T12:50:54.480451+0000","last_peered":"2024-04-25T12:50:54.480451+0000","last_clean":"2024-04-25T12:50:54.480451+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:50:54.480451+0000","last_undegraded":"2024-04-25T12:50:54.480451+0000","last_fullsized":"2024-04-25T12:50:54.480451+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:24.917278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.485570+0000","last_change":"2024-04-25T12:50:54.481281+0000","last_active":"2024-04-25T12:50:54.485570+0000","last_peered":"2024-04-25T12:50:54.485570+0000","last_clean":"2024-04-25T12:50:54.485570+0000","last_became_active":"2024-04-25T12:50:54.481059+0000","last_became_peered":"2024-04-25T12:50:54.481059+0000","last_unstale":"2024-04-25T12:50:54.485570+0000","last_undegraded":"2024-04-25T12:50:54.485570+0000","last_fullsized":"2024-04-25T12:50:54.485570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:57:19.251292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599557+0000","last_change":"2024-04-25T12:50:13.352469+0000","last_active":"2024-04-25T12:50:54.599557+0000","last_peered":"2024-04-25T12:50:54.599557+0000","last_clean":"2024-04-25T12:50:54.599557+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:50:54.599557+0000","last_undegraded":"2024-04-25T12:50:54.599557+0000","last_fullsized":"2024-04-25T12:50:54.599557+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:48.756321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478592+0000","last_change":"2024-04-25T12:50:13.357867+0000","last_active":"2024-04-25T12:50:54.478592+0000","last_peered":"2024-04-25T12:50:54.478592+0000","last_clean":"2024-04-25T12:50:54.478592+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:50:54.478592+0000","last_undegraded":"2024-04-25T12:50:54.478592+0000","last_fullsized":"2024-04-25T12:50:54.478592+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:17.276741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599472+0000","last_change":"2024-04-25T12:50:13.354695+0000","last_active":"2024-04-25T12:50:54.599472+0000","last_peered":"2024-04-25T12:50:54.599472+0000","last_clean":"2024-04-25T12:50:54.599472+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:50:54.599472+0000","last_undegraded":"2024-04-25T12:50:54.599472+0000","last_fullsized":"2024-04-25T12:50:54.599472+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.477863+0000","last_change":"2024-04-25T12:50:13.355605+0000","last_active":"2024-04-25T12:50:54.477863+0000","last_peered":"2024-04-25T12:50:54.477863+0000","last_clean":"2024-04-25T12:50:54.477863+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:50:54.477863+0000","last_undegraded":"2024-04-25T12:50:54.477863+0000","last_fullsized":"2024-04-25T12:50:54.477863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:18.190382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475040+0000","last_change":"2024-04-25T12:50:13.365793+0000","last_active":"2024-04-25T12:50:54.475040+0000","last_peered":"2024-04-25T12:50:54.475040+0000","last_clean":"2024-04-25T12:50:54.475040+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:50:54.475040+0000","last_undegraded":"2024-04-25T12:50:54.475040+0000","last_fullsized":"2024-04-25T12:50:54.475040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:51:13.188587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.475335+0000","last_change":"2024-04-25T12:50:13.365209+0000","last_active":"2024-04-25T12:50:54.475335+0000","last_peered":"2024-04-25T12:50:54.475335+0000","last_clean":"2024-04-25T12:50:54.475335+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:50:54.475335+0000","last_undegraded":"2024-04-25T12:50:54.475335+0000","last_fullsized":"2024-04-25T12:50:54.475335+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:01:54.179145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600467+0000","last_change":"2024-04-25T12:50:13.369902+0000","last_active":"2024-04-25T12:50:54.600467+0000","last_peered":"2024-04-25T12:50:54.600467+0000","last_clean":"2024-04-25T12:50:54.600467+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:50:54.600467+0000","last_undegraded":"2024-04-25T12:50:54.600467+0000","last_fullsized":"2024-04-25T12:50:54.600467+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:09:54.713555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599016+0000","last_change":"2024-04-25T12:50:13.364977+0000","last_active":"2024-04-25T12:50:54.599016+0000","last_peered":"2024-04-25T12:50:54.599016+0000","last_clean":"2024-04-25T12:50:54.599016+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:50:54.599016+0000","last_undegraded":"2024-04-25T12:50:54.599016+0000","last_fullsized":"2024-04-25T12:50:54.599016+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:02:22.918387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599533+0000","last_change":"2024-04-25T12:50:13.366862+0000","last_active":"2024-04-25T12:50:54.599533+0000","last_peered":"2024-04-25T12:50:54.599533+0000","last_clean":"2024-04-25T12:50:54.599533+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:50:54.599533+0000","last_undegraded":"2024-04-25T12:50:54.599533+0000","last_fullsized":"2024-04-25T12:50:54.599533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:25:09.318569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479446+0000","last_change":"2024-04-25T12:50:13.362802+0000","last_active":"2024-04-25T12:50:54.479446+0000","last_peered":"2024-04-25T12:50:54.479446+0000","last_clean":"2024-04-25T12:50:54.479446+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:50:54.479446+0000","last_undegraded":"2024-04-25T12:50:54.479446+0000","last_fullsized":"2024-04-25T12:50:54.479446+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:33:16.541189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599664+0000","last_change":"2024-04-25T12:50:13.365515+0000","last_active":"2024-04-25T12:50:54.599664+0000","last_peered":"2024-04-25T12:50:54.599664+0000","last_clean":"2024-04-25T12:50:54.599664+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:50:54.599664+0000","last_undegraded":"2024-04-25T12:50:54.599664+0000","last_fullsized":"2024-04-25T12:50:54.599664+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:52:10.930338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.479221+0000","last_change":"2024-04-25T12:50:13.361076+0000","last_active":"2024-04-25T12:50:54.479221+0000","last_peered":"2024-04-25T12:50:54.479221+0000","last_clean":"2024-04-25T12:50:54.479221+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:50:54.479221+0000","last_undegraded":"2024-04-25T12:50:54.479221+0000","last_fullsized":"2024-04-25T12:50:54.479221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:42:07.787728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.478790+0000","last_change":"2024-04-25T12:50:13.359392+0000","last_active":"2024-04-25T12:50:54.478790+0000","last_peered":"2024-04-25T12:50:54.478790+0000","last_clean":"2024-04-25T12:50:54.478790+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:50:54.478790+0000","last_undegraded":"2024-04-25T12:50:54.478790+0000","last_fullsized":"2024-04-25T12:50:54.478790+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:33:36.308022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600065+0000","last_change":"2024-04-25T12:50:13.361811+0000","last_active":"2024-04-25T12:50:54.600065+0000","last_peered":"2024-04-25T12:50:54.600065+0000","last_clean":"2024-04-25T12:50:54.600065+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:50:54.600065+0000","last_undegraded":"2024-04-25T12:50:54.600065+0000","last_fullsized":"2024-04-25T12:50:54.600065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:44:28.309814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.600380+0000","last_change":"2024-04-25T12:50:13.362243+0000","last_active":"2024-04-25T12:50:54.600380+0000","last_peered":"2024-04-25T12:50:54.600380+0000","last_clean":"2024-04-25T12:50:54.600380+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:50:54.600380+0000","last_undegraded":"2024-04-25T12:50:54.600380+0000","last_fullsized":"2024-04-25T12:50:54.600380+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:12.327184+0000","last_clean_scrub_stamp":"2024-04-25T12:50:12.327184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:45:11.948102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5037,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45,"ondisk_log_size":45,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542158,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":294912,"data_stored":118719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542159,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27892,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343948,"statfs":{"total":96636764160,"available":96608202752,"internally_reserved":0,"allocated":892928,"data_stored":709565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32044,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339796,"statfs":{"total":96636764160,"available":96603951104,"internally_reserved":0,"allocated":884736,"data_stored":709509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":122798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":290816,"data_stored":118649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":299008,"data_stored":118685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":299008,"data_stored":122798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":286720,"data_stored":118559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:51:03.098 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.099 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.099 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.099 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.099 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.099 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.100 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.100 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.100 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.100 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.101 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.101 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.101 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.101 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.101 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.101 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.102 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.102 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.102 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.102 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.102 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.103 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.103 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.103 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.103 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.103 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.104 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.104 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.104 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.104 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.104 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.104 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.105 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.105 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.105 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.105 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.105 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.105 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.106 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.106 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.106 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.106 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.106 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.107 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.107 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.107 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.107 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.107 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T12:50:01.294396+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=1, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.107 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.108 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.108 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.108 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.108 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.108 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.108 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.109 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.109 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.109 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.109 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.109 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.109 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.110 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.110 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.110 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.110 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.110 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.110 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.111 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.111 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.111 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.111 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.111 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.112 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.112 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.112 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.112 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.112 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.112 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.113 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.113 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.113 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.113 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.113 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.113 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.114 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.114 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.114 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.114 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.114 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.114 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.115 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.115 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.115 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.115 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.115 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-25T12:50:11.320473+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=11, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.115 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.116 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.116 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.116 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.116 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.116 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.116 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.117 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.117 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.117 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.117 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.117 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.117 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.118 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.118 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.118 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.118 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.118 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.119 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.119 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.119 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.119 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.119 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.119 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.120 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.120 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.120 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.120 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.120 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.120 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.121 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.121 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.121 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.121 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-25T12:50:12.327184+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=12, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:03.121 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T12:51:10.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:10.180 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:23.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:51:23.232 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.234+0000 7f6044120640 1 Processor -- start 2024-04-25T12:51:23.233 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.234+0000 7f6044120640 1 -- start start 2024-04-25T12:51:23.235 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6044120640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6044120640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f603c0c5870 0x7f603c0c81e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6044120640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f603c15d330 0x7f603c0c8720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6044120640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f603c15c680 con 0x7f603c0c5870 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6044120640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f603c15a580 con 0x7f603c15d330 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6044120640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f603c159640 con 0x7f603c0cbd90 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f603c0c5870 0x7f603c0c81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f603c0c5870 0x7f603c0c81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36876/0 (socket says 172.21.15.132:36876) 2024-04-25T12:51:23.236 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 -- 172.21.15.132:0/1243282177 learned_addr learned my addr 172.21.15.132:0/1243282177 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60426bd640 1 --2- 172.21.15.132:0/1243282177 >> v2:172.21.15.157:3300/0 conn(0x7f603c15d330 0x7f603c0c8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f6041ebc640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 -- 172.21.15.132:0/1243282177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 msgr2=0x7f603c15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c15cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 -- 172.21.15.132:0/1243282177 >> v2:172.21.15.157:3300/0 conn(0x7f603c15d330 msgr2=0x7f603c0c8720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 --2- 172.21.15.132:0/1243282177 >> v2:172.21.15.157:3300/0 conn(0x7f603c15d330 0x7f603c0c8720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.235+0000 7f60416bb640 1 -- 172.21.15.132:0/1243282177 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c159920 con 0x7f603c0c5870 2024-04-25T12:51:23.237 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.236+0000 7f6041ebc640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.236+0000 7f60426bd640 1 --2- 172.21.15.132:0/1243282177 >> v2:172.21.15.157:3300/0 conn(0x7f603c15d330 0x7f603c0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.236+0000 7f60416bb640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c0c5870 0x7f603c0c81e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f602c009870 tx=0x7f602c02a2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=212e8723669a9e73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.236+0000 7f6040eba640 1 -- 172.21.15.132:0/1243282177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c037070 con 0x7f603c0c5870 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.236+0000 7f6040eba640 1 -- 172.21.15.132:0/1243282177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f602c032440 con 0x7f603c0c5870 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.236+0000 7f6040eba640 1 -- 172.21.15.132:0/1243282177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f602c032810 con 0x7f603c0c5870 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 -- 172.21.15.132:0/1243282177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c0c5870 msgr2=0x7f603c0c81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c0c5870 0x7f603c0c81e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f602c009870 tx=0x7f602c02a2a0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 -- 172.21.15.132:0/1243282177 shutdown_connections 2024-04-25T12:51:23.238 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c0c5870 0x7f603c0c81e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 --2- 172.21.15.132:0/1243282177 >> v2:172.21.15.157:3300/0 conn(0x7f603c15d330 0x7f603c0c8720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 --2- 172.21.15.132:0/1243282177 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c15cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 -- 172.21.15.132:0/1243282177 >> 172.21.15.132:0/1243282177 conn(0x7f603c072f10 msgr2=0x7f603c073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:23.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 -- 172.21.15.132:0/1243282177 shutdown_connections 2024-04-25T12:51:23.239 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.237+0000 7f6044120640 1 -- 172.21.15.132:0/1243282177 wait complete. 2024-04-25T12:51:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.238+0000 7f6044120640 1 Processor -- start 2024-04-25T12:51:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.238+0000 7f6044120640 1 -- start start 2024-04-25T12:51:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6044120640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0c5870 0x7f603c1f1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6044120640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c0c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6044120640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 0x7f603c14ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6044120640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f603c15c8d0 con 0x7f603c15d330 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6044120640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f603c159ee0 con 0x7f603c0c5870 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6044120640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f603c0cc170 con 0x7f603c0cbd90 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 0x7f603c14ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 0x7f603c14ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36882/0 (socket says 172.21.15.132:36882) 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 -- 172.21.15.132:0/3049892121 learned_addr learned my addr 172.21.15.132:0/3049892121 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60416bb640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c0c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6041ebc640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0c5870 0x7f603c1f1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 -- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 msgr2=0x7f603c0c47b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:23.243 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c0c47b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 -- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0c5870 msgr2=0x7f603c1f1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0c5870 0x7f603c1f1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 -- 172.21.15.132:0/3049892121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f603c14e5e0 con 0x7f603c15d330 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f6041ebc640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0c5870 0x7f603c1f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.239+0000 7f60426bd640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 0x7f603c14ed70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f603400cd10 tx=0x7f603400a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.240+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034003b90 con 0x7f603c15d330 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.240+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6034003d50 con 0x7f603c15d330 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.240+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f603c06c350 con 0x7f603c15d330 2024-04-25T12:51:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.240+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6034004260 con 0x7f603c15d330 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.240+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f603c06c8f0 con 0x7f603c15d330 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.241+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f603c0c7ce0 con 0x7f603c15d330 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.241+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6034004400 con 0x7f603c15d330 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.241+0000 7f60327fc640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f602006c8f0 0x7f602006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.242+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f603408c8f0 con 0x7f603c15d330 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.242+0000 7f6041ebc640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f602006c8f0 0x7f602006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.242+0000 7f6041ebc640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f602006c8f0 0x7f602006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f603800aa30 tx=0x7f6038008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:23.246 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.246+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f603c0c7ce0 con 0x7f603c15d330 2024-04-25T12:51:23.415 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.417+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f603c068c20 con 0x7f602006c8f0 2024-04-25T12:51:23.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.424+0000 7f60327fc640 1 -- 172.21.15.132:0/3049892121 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332520 (secure 0 0 0) 0x7f603c068c20 con 0x7f602006c8f0 2024-04-25T12:51:23.426 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:51:23.428 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:51:23.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f602006c8f0 msgr2=0x7f602006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:23.429 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f602006c8f0 0x7f602006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f603800aa30 tx=0x7f6038008040 comp rx=0 tx=0).stop 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 msgr2=0x7f603c14ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 0x7f603c14ed70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f603400cd10 tx=0x7f603400a650 comp rx=0 tx=0).stop 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 shutdown_connections 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f602006c8f0 0x7f602006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f603c15d330 0x7f603c14ed70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f603c0cbd90 0x7f603c0c47b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.430 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 --2- 172.21.15.132:0/3049892121 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f603c0c5870 0x7f603c1f1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:23.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 >> 172.21.15.132:0/3049892121 conn(0x7f603c072f10 msgr2=0x7f603c157bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:23.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.427+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 shutdown_connections 2024-04-25T12:51:23.431 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:23.428+0000 7f6044120640 1 -- 172.21.15.132:0/3049892121 wait complete. 2024-04-25T12:51:23.436 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2024-04-25T12:51:23.143114+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595405,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":210,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236232,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738488,"statfs":{"total":773094113280,"available":772852211712,"internally_reserved":0,"allocated":3547136,"data_stored":2139282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002893"},"pg_stats":[{"pgid":"2.1f","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.723055+0000","last_change":"2024-04-25T12:51:02.723080+0000","last_active":"2024-04-25T12:51:02.723055+0000","last_peered":"2024-04-25T12:51:02.723055+0000","last_clean":"2024-04-25T12:51:02.723055+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:51:02.723055+0000","last_undegraded":"2024-04-25T12:51:02.723055+0000","last_fullsized":"2024-04-25T12:51:02.723055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T12:51:02.722999+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T12:51:02.722999+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.722999+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:39.859559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.337930+0000","last_change":"2024-04-25T12:51:09.337954+0000","last_active":"2024-04-25T12:51:09.337930+0000","last_peered":"2024-04-25T12:51:09.337930+0000","last_clean":"2024-04-25T12:51:09.337930+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:51:09.337930+0000","last_undegraded":"2024-04-25T12:51:09.337930+0000","last_fullsized":"2024-04-25T12:51:09.337930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.337827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.337827+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.337827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:13.114476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599322+0000","last_change":"2024-04-25T12:50:17.400163+0000","last_active":"2024-04-25T12:50:54.599322+0000","last_peered":"2024-04-25T12:50:54.599322+0000","last_clean":"2024-04-25T12:50:54.599322+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:50:54.599322+0000","last_undegraded":"2024-04-25T12:50:54.599322+0000","last_fullsized":"2024-04-25T12:50:54.599322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.309148+0000","last_change":"2024-04-25T12:51:06.309173+0000","last_active":"2024-04-25T12:51:06.309148+0000","last_peered":"2024-04-25T12:51:06.309148+0000","last_clean":"2024-04-25T12:51:06.309148+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:51:06.309148+0000","last_undegraded":"2024-04-25T12:51:06.309148+0000","last_fullsized":"2024-04-25T12:51:06.309148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T12:51:06.309059+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T12:51:06.309059+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.309059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:49.904702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.740487+0000","last_change":"2024-04-25T12:51:16.740512+0000","last_active":"2024-04-25T12:51:16.740487+0000","last_peered":"2024-04-25T12:51:16.740487+0000","last_clean":"2024-04-25T12:51:16.740487+0000","last_became_active":"2024-04-25T12:50:54.602420+0000","last_became_peered":"2024-04-25T12:50:54.602420+0000","last_unstale":"2024-04-25T12:51:16.740487+0000","last_undegraded":"2024-04-25T12:51:16.740487+0000","last_fullsized":"2024-04-25T12:51:16.740487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.740403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.740403+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.740403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:08.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.722547+0000","last_change":"2024-04-25T12:51:09.722614+0000","last_active":"2024-04-25T12:51:09.722547+0000","last_peered":"2024-04-25T12:51:09.722547+0000","last_clean":"2024-04-25T12:51:09.722547+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:51:09.722547+0000","last_undegraded":"2024-04-25T12:51:09.722547+0000","last_fullsized":"2024-04-25T12:51:09.722547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.722446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.722446+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.722446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:08.029364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.481805+0000","last_change":"2024-04-25T12:51:05.481834+0000","last_active":"2024-04-25T12:51:05.481805+0000","last_peered":"2024-04-25T12:51:05.481805+0000","last_clean":"2024-04-25T12:51:05.481805+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:51:05.481805+0000","last_undegraded":"2024-04-25T12:51:05.481805+0000","last_fullsized":"2024-04-25T12:51:05.481805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:05.481719+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:05.481719+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.481719+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:30.274725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.546731+0000","last_change":"2024-04-25T12:51:09.546752+0000","last_active":"2024-04-25T12:51:09.546731+0000","last_peered":"2024-04-25T12:51:09.546731+0000","last_clean":"2024-04-25T12:51:09.546731+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:51:09.546731+0000","last_undegraded":"2024-04-25T12:51:09.546731+0000","last_fullsized":"2024-04-25T12:51:09.546731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.546642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.546642+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.546642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:39.976498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.749172+0000","last_change":"2024-04-25T12:51:08.749199+0000","last_active":"2024-04-25T12:51:08.749172+0000","last_peered":"2024-04-25T12:51:08.749172+0000","last_clean":"2024-04-25T12:51:08.749172+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:51:08.749172+0000","last_undegraded":"2024-04-25T12:51:08.749172+0000","last_fullsized":"2024-04-25T12:51:08.749172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.749083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.749083+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.749083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.692869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.522777+0000","last_change":"2024-04-25T12:51:08.522824+0000","last_active":"2024-04-25T12:51:08.522777+0000","last_peered":"2024-04-25T12:51:08.522777+0000","last_clean":"2024-04-25T12:51:08.522777+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:51:08.522777+0000","last_undegraded":"2024-04-25T12:51:08.522777+0000","last_fullsized":"2024-04-25T12:51:08.522777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:08.522658+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:08.522658+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.522658+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:08.103301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.541925+0000","last_change":"2024-04-25T12:51:10.541962+0000","last_active":"2024-04-25T12:51:10.541925+0000","last_peered":"2024-04-25T12:51:10.541925+0000","last_clean":"2024-04-25T12:51:10.541925+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:51:10.541925+0000","last_undegraded":"2024-04-25T12:51:10.541925+0000","last_fullsized":"2024-04-25T12:51:10.541925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.541812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.541812+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.541812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:12.848210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.685727+0000","last_change":"2024-04-25T12:51:11.685756+0000","last_active":"2024-04-25T12:51:11.685727+0000","last_peered":"2024-04-25T12:51:11.685727+0000","last_clean":"2024-04-25T12:51:11.685727+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:51:11.685727+0000","last_undegraded":"2024-04-25T12:51:11.685727+0000","last_fullsized":"2024-04-25T12:51:11.685727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.685645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.685645+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.685645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:56.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.000092+0000","last_change":"2024-04-25T12:51:08.000121+0000","last_active":"2024-04-25T12:51:08.000092+0000","last_peered":"2024-04-25T12:51:08.000092+0000","last_clean":"2024-04-25T12:51:08.000092+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:51:08.000092+0000","last_undegraded":"2024-04-25T12:51:08.000092+0000","last_fullsized":"2024-04-25T12:51:08.000092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.000012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.000012+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.000012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:24.048897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.570684+0000","last_change":"2024-04-25T12:51:07.570737+0000","last_active":"2024-04-25T12:51:07.570684+0000","last_peered":"2024-04-25T12:51:07.570684+0000","last_clean":"2024-04-25T12:51:07.570684+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:51:07.570684+0000","last_undegraded":"2024-04-25T12:51:07.570684+0000","last_fullsized":"2024-04-25T12:51:07.570684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:07.570586+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:07.570586+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.570586+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:30.995424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.667390+0000","last_change":"2024-04-25T12:51:12.667417+0000","last_active":"2024-04-25T12:51:12.667390+0000","last_peered":"2024-04-25T12:51:12.667390+0000","last_clean":"2024-04-25T12:51:12.667390+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:51:12.667390+0000","last_undegraded":"2024-04-25T12:51:12.667390+0000","last_fullsized":"2024-04-25T12:51:12.667390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.667310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.667310+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.667310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:02.308909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.380427+0000","last_change":"2024-04-25T12:51:01.380460+0000","last_active":"2024-04-25T12:51:01.380427+0000","last_peered":"2024-04-25T12:51:01.380427+0000","last_clean":"2024-04-25T12:51:01.380427+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:51:01.380427+0000","last_undegraded":"2024-04-25T12:51:01.380427+0000","last_fullsized":"2024-04-25T12:51:01.380427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:01.380337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:01.380337+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.380337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:34.283147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.715626+0000","last_change":"2024-04-25T12:51:06.715651+0000","last_active":"2024-04-25T12:51:06.715626+0000","last_peered":"2024-04-25T12:51:06.715626+0000","last_clean":"2024-04-25T12:51:06.715626+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:51:06.715626+0000","last_undegraded":"2024-04-25T12:51:06.715626+0000","last_fullsized":"2024-04-25T12:51:06.715626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.715544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.715544+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.715544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:56.405048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.606855+0000","last_change":"2024-04-25T12:51:14.606883+0000","last_active":"2024-04-25T12:51:14.606855+0000","last_peered":"2024-04-25T12:51:14.606855+0000","last_clean":"2024-04-25T12:51:14.606855+0000","last_became_active":"2024-04-25T12:50:54.601163+0000","last_became_peered":"2024-04-25T12:50:54.601163+0000","last_unstale":"2024-04-25T12:51:14.606855+0000","last_undegraded":"2024-04-25T12:51:14.606855+0000","last_fullsized":"2024-04-25T12:51:14.606855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.606771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.606771+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.606771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:25.831629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.329329+0000","last_change":"2024-04-25T12:51:12.329353+0000","last_active":"2024-04-25T12:51:12.329329+0000","last_peered":"2024-04-25T12:51:12.329329+0000","last_clean":"2024-04-25T12:51:12.329329+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:51:12.329329+0000","last_undegraded":"2024-04-25T12:51:12.329329+0000","last_fullsized":"2024-04-25T12:51:12.329329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.329238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.329238+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.329238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:49.992747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.738516+0000","last_change":"2024-04-25T12:51:03.738539+0000","last_active":"2024-04-25T12:51:03.738516+0000","last_peered":"2024-04-25T12:51:03.738516+0000","last_clean":"2024-04-25T12:51:03.738516+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:51:03.738516+0000","last_undegraded":"2024-04-25T12:51:03.738516+0000","last_fullsized":"2024-04-25T12:51:03.738516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.738444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.738444+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.738444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:26.813101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.732483+0000","last_change":"2024-04-25T12:51:16.732509+0000","last_active":"2024-04-25T12:51:16.732483+0000","last_peered":"2024-04-25T12:51:16.732483+0000","last_clean":"2024-04-25T12:51:16.732483+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:51:16.732483+0000","last_undegraded":"2024-04-25T12:51:16.732483+0000","last_fullsized":"2024-04-25T12:51:16.732483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.732391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.732391+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.732391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:17.402606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.805704+0000","last_change":"2024-04-25T12:51:05.805728+0000","last_active":"2024-04-25T12:51:05.805704+0000","last_peered":"2024-04-25T12:51:05.805704+0000","last_clean":"2024-04-25T12:51:05.805704+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:51:05.805704+0000","last_undegraded":"2024-04-25T12:51:05.805704+0000","last_fullsized":"2024-04-25T12:51:05.805704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.805623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.805623+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.805623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:00.245909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.492918+0000","last_change":"2024-04-25T12:51:10.492942+0000","last_active":"2024-04-25T12:51:10.492918+0000","last_peered":"2024-04-25T12:51:10.492918+0000","last_clean":"2024-04-25T12:51:10.492918+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:51:10.492918+0000","last_undegraded":"2024-04-25T12:51:10.492918+0000","last_fullsized":"2024-04-25T12:51:10.492918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.492831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.492831+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.492831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:47.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.677025+0000","last_change":"2024-04-25T12:51:10.677070+0000","last_active":"2024-04-25T12:51:10.677025+0000","last_peered":"2024-04-25T12:51:10.677025+0000","last_clean":"2024-04-25T12:51:10.677025+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:51:10.677025+0000","last_undegraded":"2024-04-25T12:51:10.677025+0000","last_fullsized":"2024-04-25T12:51:10.677025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.676917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.676917+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.676917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:28:14.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.782150+0000","last_change":"2024-04-25T12:51:04.782192+0000","last_active":"2024-04-25T12:51:04.782150+0000","last_peered":"2024-04-25T12:51:04.782150+0000","last_clean":"2024-04-25T12:51:04.782150+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:51:04.782150+0000","last_undegraded":"2024-04-25T12:51:04.782150+0000","last_fullsized":"2024-04-25T12:51:04.782150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.782025+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:43.044316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.942943+0000","last_change":"2024-04-25T12:51:02.942982+0000","last_active":"2024-04-25T12:51:02.942943+0000","last_peered":"2024-04-25T12:51:02.942943+0000","last_clean":"2024-04-25T12:51:02.942943+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:51:02.942943+0000","last_undegraded":"2024-04-25T12:51:02.942943+0000","last_fullsized":"2024-04-25T12:51:02.942943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:02.942866+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:02.942866+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.942866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:30.066511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.654285+0000","last_change":"2024-04-25T12:51:13.654323+0000","last_active":"2024-04-25T12:51:13.654285+0000","last_peered":"2024-04-25T12:51:13.654285+0000","last_clean":"2024-04-25T12:51:13.654285+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:51:13.654285+0000","last_undegraded":"2024-04-25T12:51:13.654285+0000","last_fullsized":"2024-04-25T12:51:13.654285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.654181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.654181+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.654181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:55.620316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.321039+0000","last_change":"2024-04-25T12:51:03.321079+0000","last_active":"2024-04-25T12:51:03.321039+0000","last_peered":"2024-04-25T12:51:03.321039+0000","last_clean":"2024-04-25T12:51:03.321039+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:51:03.321039+0000","last_undegraded":"2024-04-25T12:51:03.321039+0000","last_fullsized":"2024-04-25T12:51:03.321039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.320957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.320957+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.320957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:41.364621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.747475+0000","last_change":"2024-04-25T12:51:02.747498+0000","last_active":"2024-04-25T12:51:02.747475+0000","last_peered":"2024-04-25T12:51:02.747475+0000","last_clean":"2024-04-25T12:51:02.747475+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:51:02.747475+0000","last_undegraded":"2024-04-25T12:51:02.747475+0000","last_fullsized":"2024-04-25T12:51:02.747475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T12:51:02.747410+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T12:51:02.747410+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.747410+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.868791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.392389+0000","last_change":"2024-04-25T12:51:17.392419+0000","last_active":"2024-04-25T12:51:17.392389+0000","last_peered":"2024-04-25T12:51:17.392389+0000","last_clean":"2024-04-25T12:51:17.392389+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:51:17.392389+0000","last_undegraded":"2024-04-25T12:51:17.392389+0000","last_fullsized":"2024-04-25T12:51:17.392389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.392300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.392300+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.392300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:54.712390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.817076+0000","last_change":"2024-04-25T12:51:09.817104+0000","last_active":"2024-04-25T12:51:09.817076+0000","last_peered":"2024-04-25T12:51:09.817076+0000","last_clean":"2024-04-25T12:51:09.817076+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:51:09.817076+0000","last_undegraded":"2024-04-25T12:51:09.817076+0000","last_fullsized":"2024-04-25T12:51:09.817076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.816999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.816999+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.816999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:54.865464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.486865+0000","last_change":"2024-04-25T12:51:09.486909+0000","last_active":"2024-04-25T12:51:09.486865+0000","last_peered":"2024-04-25T12:51:09.486865+0000","last_clean":"2024-04-25T12:51:09.486865+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:51:09.486865+0000","last_undegraded":"2024-04-25T12:51:09.486865+0000","last_fullsized":"2024-04-25T12:51:09.486865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.486764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.486764+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.486764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:51.523713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.685332+0000","last_change":"2024-04-25T12:51:12.685359+0000","last_active":"2024-04-25T12:51:12.685332+0000","last_peered":"2024-04-25T12:51:12.685332+0000","last_clean":"2024-04-25T12:51:12.685332+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:51:12.685332+0000","last_undegraded":"2024-04-25T12:51:12.685332+0000","last_fullsized":"2024-04-25T12:51:12.685332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.685243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.685243+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.685243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:02.571712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.492040+0000","last_change":"2024-04-25T12:51:02.492063+0000","last_active":"2024-04-25T12:51:02.492040+0000","last_peered":"2024-04-25T12:51:02.492040+0000","last_clean":"2024-04-25T12:51:02.492040+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:51:02.492040+0000","last_undegraded":"2024-04-25T12:51:02.492040+0000","last_fullsized":"2024-04-25T12:51:02.492040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.491950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.491950+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.491950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:18.674913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.794376+0000","last_change":"2024-04-25T12:51:01.794395+0000","last_active":"2024-04-25T12:51:01.794376+0000","last_peered":"2024-04-25T12:51:01.794376+0000","last_clean":"2024-04-25T12:51:01.794376+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:51:01.794376+0000","last_undegraded":"2024-04-25T12:51:01.794376+0000","last_fullsized":"2024-04-25T12:51:01.794376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:01.794295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:01.794295+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.794295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.728373+0000","last_change":"2024-04-25T12:51:13.728418+0000","last_active":"2024-04-25T12:51:13.728373+0000","last_peered":"2024-04-25T12:51:13.728373+0000","last_clean":"2024-04-25T12:51:13.728373+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:51:13.728373+0000","last_undegraded":"2024-04-25T12:51:13.728373+0000","last_fullsized":"2024-04-25T12:51:13.728373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.728252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.728252+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.728252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:29.814969+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.756591+0000","last_change":"2024-04-25T12:51:03.756632+0000","last_active":"2024-04-25T12:51:03.756591+0000","last_peered":"2024-04-25T12:51:03.756591+0000","last_clean":"2024-04-25T12:51:03.756591+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:51:03.756591+0000","last_undegraded":"2024-04-25T12:51:03.756591+0000","last_fullsized":"2024-04-25T12:51:03.756591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.756491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.756491+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.756491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:00.314752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.577388+0000","last_change":"2024-04-25T12:51:05.577433+0000","last_active":"2024-04-25T12:51:05.577388+0000","last_peered":"2024-04-25T12:51:05.577388+0000","last_clean":"2024-04-25T12:51:05.577388+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:51:05.577388+0000","last_undegraded":"2024-04-25T12:51:05.577388+0000","last_fullsized":"2024-04-25T12:51:05.577388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.577284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.577284+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.577284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:09.517481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.767705+0000","last_change":"2024-04-25T12:51:12.767732+0000","last_active":"2024-04-25T12:51:12.767705+0000","last_peered":"2024-04-25T12:51:12.767705+0000","last_clean":"2024-04-25T12:51:12.767705+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:51:12.767705+0000","last_undegraded":"2024-04-25T12:51:12.767705+0000","last_fullsized":"2024-04-25T12:51:12.767705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.767621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.767621+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.767621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:43.571297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.799388+0000","last_change":"2024-04-25T12:51:10.799414+0000","last_active":"2024-04-25T12:51:10.799388+0000","last_peered":"2024-04-25T12:51:10.799388+0000","last_clean":"2024-04-25T12:51:10.799388+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:51:10.799388+0000","last_undegraded":"2024-04-25T12:51:10.799388+0000","last_fullsized":"2024-04-25T12:51:10.799388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.799297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.799297+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.799297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:10.033758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.394536+0000","last_change":"2024-04-25T12:51:04.394564+0000","last_active":"2024-04-25T12:51:04.394536+0000","last_peered":"2024-04-25T12:51:04.394536+0000","last_clean":"2024-04-25T12:51:04.394536+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:51:04.394536+0000","last_undegraded":"2024-04-25T12:51:04.394536+0000","last_fullsized":"2024-04-25T12:51:04.394536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.394442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.394442+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.394442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:18.351356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.771332+0000","last_change":"2024-04-25T12:51:15.771359+0000","last_active":"2024-04-25T12:51:15.771332+0000","last_peered":"2024-04-25T12:51:15.771332+0000","last_clean":"2024-04-25T12:51:15.771332+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:51:15.771332+0000","last_undegraded":"2024-04-25T12:51:15.771332+0000","last_fullsized":"2024-04-25T12:51:15.771332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.771239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.771239+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.771239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:44.282059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.723527+0000","last_change":"2024-04-25T12:51:09.723554+0000","last_active":"2024-04-25T12:51:09.723527+0000","last_peered":"2024-04-25T12:51:09.723527+0000","last_clean":"2024-04-25T12:51:09.723527+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:51:09.723527+0000","last_undegraded":"2024-04-25T12:51:09.723527+0000","last_fullsized":"2024-04-25T12:51:09.723527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.723426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.723426+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.723426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:39.504056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.527191+0000","last_change":"2024-04-25T12:51:06.527217+0000","last_active":"2024-04-25T12:51:06.527191+0000","last_peered":"2024-04-25T12:51:06.527191+0000","last_clean":"2024-04-25T12:51:06.527191+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:51:06.527191+0000","last_undegraded":"2024-04-25T12:51:06.527191+0000","last_fullsized":"2024-04-25T12:51:06.527191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.527093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.527093+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.527093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:54.880603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.755472+0000","last_change":"2024-04-25T12:51:15.755496+0000","last_active":"2024-04-25T12:51:15.755472+0000","last_peered":"2024-04-25T12:51:15.755472+0000","last_clean":"2024-04-25T12:51:15.755472+0000","last_became_active":"2024-04-25T12:50:54.601056+0000","last_became_peered":"2024-04-25T12:50:54.601056+0000","last_unstale":"2024-04-25T12:51:15.755472+0000","last_undegraded":"2024-04-25T12:51:15.755472+0000","last_fullsized":"2024-04-25T12:51:15.755472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.755389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.755389+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.755389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:19.578345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.360868+0000","last_change":"2024-04-25T12:51:02.360916+0000","last_active":"2024-04-25T12:51:02.360868+0000","last_peered":"2024-04-25T12:51:02.360868+0000","last_clean":"2024-04-25T12:51:02.360868+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:51:02.360868+0000","last_undegraded":"2024-04-25T12:51:02.360868+0000","last_fullsized":"2024-04-25T12:51:02.360868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.360788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.360788+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.360788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:45.845999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.512291+0000","last_change":"2024-04-25T12:51:03.512313+0000","last_active":"2024-04-25T12:51:03.512291+0000","last_peered":"2024-04-25T12:51:03.512291+0000","last_clean":"2024-04-25T12:51:03.512291+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:51:03.512291+0000","last_undegraded":"2024-04-25T12:51:03.512291+0000","last_fullsized":"2024-04-25T12:51:03.512291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.512194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.512194+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.512194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:22.999616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.492515+0000","last_change":"2024-04-25T12:51:04.492547+0000","last_active":"2024-04-25T12:51:04.492515+0000","last_peered":"2024-04-25T12:51:04.492515+0000","last_clean":"2024-04-25T12:51:04.492515+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:51:04.492515+0000","last_undegraded":"2024-04-25T12:51:04.492515+0000","last_fullsized":"2024-04-25T12:51:04.492515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-25T12:51:04.492404+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-25T12:51:04.492404+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.492404+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:28.084498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.059483+0000","last_change":"2024-04-25T12:51:16.059526+0000","last_active":"2024-04-25T12:51:16.059483+0000","last_peered":"2024-04-25T12:51:16.059483+0000","last_clean":"2024-04-25T12:51:16.059483+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:51:16.059483+0000","last_undegraded":"2024-04-25T12:51:16.059483+0000","last_fullsized":"2024-04-25T12:51:16.059483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.059379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.059379+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.059379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:19.185284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:18.517606+0000","last_change":"2024-04-25T12:51:18.517650+0000","last_active":"2024-04-25T12:51:18.517606+0000","last_peered":"2024-04-25T12:51:18.517606+0000","last_clean":"2024-04-25T12:51:18.517606+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:51:18.517606+0000","last_undegraded":"2024-04-25T12:51:18.517606+0000","last_fullsized":"2024-04-25T12:51:18.517606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:18.517506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:18.517506+0000","last_clean_scrub_stamp":"2024-04-25T12:51:18.517506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:26.076937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.402133+0000","last_change":"2024-04-25T12:51:02.402165+0000","last_active":"2024-04-25T12:51:02.402133+0000","last_peered":"2024-04-25T12:51:02.402133+0000","last_clean":"2024-04-25T12:51:02.402133+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:51:02.402133+0000","last_undegraded":"2024-04-25T12:51:02.402133+0000","last_fullsized":"2024-04-25T12:51:02.402133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.402044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.402044+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.402044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:27.478685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.053584+0000","last_change":"2024-04-25T12:51:17.053612+0000","last_active":"2024-04-25T12:51:17.053584+0000","last_peered":"2024-04-25T12:51:17.053584+0000","last_clean":"2024-04-25T12:51:17.053584+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:51:17.053584+0000","last_undegraded":"2024-04-25T12:51:17.053584+0000","last_fullsized":"2024-04-25T12:51:17.053584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.053497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.053497+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.053497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:22.064749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.568400+0000","last_change":"2024-04-25T12:51:12.568431+0000","last_active":"2024-04-25T12:51:12.568400+0000","last_peered":"2024-04-25T12:51:12.568400+0000","last_clean":"2024-04-25T12:51:12.568400+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:51:12.568400+0000","last_undegraded":"2024-04-25T12:51:12.568400+0000","last_fullsized":"2024-04-25T12:51:12.568400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.568303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.568303+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.568303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.912471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.738000+0000","last_change":"2024-04-25T12:51:05.738029+0000","last_active":"2024-04-25T12:51:05.738000+0000","last_peered":"2024-04-25T12:51:05.738000+0000","last_clean":"2024-04-25T12:51:05.738000+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:51:05.738000+0000","last_undegraded":"2024-04-25T12:51:05.738000+0000","last_fullsized":"2024-04-25T12:51:05.738000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T12:51:05.737920+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T12:51:05.737920+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.737920+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:28.901490+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.643041+0000","last_change":"2024-04-25T12:51:11.643067+0000","last_active":"2024-04-25T12:51:11.643041+0000","last_peered":"2024-04-25T12:51:11.643041+0000","last_clean":"2024-04-25T12:51:11.643041+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:51:11.643041+0000","last_undegraded":"2024-04-25T12:51:11.643041+0000","last_fullsized":"2024-04-25T12:51:11.643041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.642954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.642954+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.642954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:16.068665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.491953+0000","last_change":"2024-04-25T12:51:14.491986+0000","last_active":"2024-04-25T12:51:14.491953+0000","last_peered":"2024-04-25T12:51:14.491953+0000","last_clean":"2024-04-25T12:51:14.491953+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:51:14.491953+0000","last_undegraded":"2024-04-25T12:51:14.491953+0000","last_fullsized":"2024-04-25T12:51:14.491953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.491865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.491865+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.491865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.006540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.418728+0000","last_change":"2024-04-25T12:51:03.418775+0000","last_active":"2024-04-25T12:51:03.418728+0000","last_peered":"2024-04-25T12:51:03.418728+0000","last_clean":"2024-04-25T12:51:03.418728+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:51:03.418728+0000","last_undegraded":"2024-04-25T12:51:03.418728+0000","last_fullsized":"2024-04-25T12:51:03.418728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:03.418654+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:03.418654+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.418654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:58.826372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.615142+0000","last_change":"2024-04-25T12:51:17.615169+0000","last_active":"2024-04-25T12:51:17.615142+0000","last_peered":"2024-04-25T12:51:17.615142+0000","last_clean":"2024-04-25T12:51:17.615142+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:51:17.615142+0000","last_undegraded":"2024-04-25T12:51:17.615142+0000","last_fullsized":"2024-04-25T12:51:17.615142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.615050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.615050+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.615050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:32.809936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.516707+0000","last_change":"2024-04-25T12:51:16.516739+0000","last_active":"2024-04-25T12:51:16.516707+0000","last_peered":"2024-04-25T12:51:16.516707+0000","last_clean":"2024-04-25T12:51:16.516707+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:51:16.516707+0000","last_undegraded":"2024-04-25T12:51:16.516707+0000","last_fullsized":"2024-04-25T12:51:16.516707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.516612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.516612+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.516612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:44.872281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.767644+0000","last_change":"2024-04-25T12:51:01.767679+0000","last_active":"2024-04-25T12:51:01.767644+0000","last_peered":"2024-04-25T12:51:01.767644+0000","last_clean":"2024-04-25T12:51:01.767644+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:51:01.767644+0000","last_undegraded":"2024-04-25T12:51:01.767644+0000","last_fullsized":"2024-04-25T12:51:01.767644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T12:51:01.767555+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T12:51:01.767555+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.767555+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:32.612163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.599810+0000","last_change":"2024-04-25T12:51:15.599867+0000","last_active":"2024-04-25T12:51:15.599810+0000","last_peered":"2024-04-25T12:51:15.599810+0000","last_clean":"2024-04-25T12:51:15.599810+0000","last_became_active":"2024-04-25T12:50:54.601336+0000","last_became_peered":"2024-04-25T12:50:54.601336+0000","last_unstale":"2024-04-25T12:51:15.599810+0000","last_undegraded":"2024-04-25T12:51:15.599810+0000","last_fullsized":"2024-04-25T12:51:15.599810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.599709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.599709+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.599709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:26.335500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.413949+0000","last_change":"2024-04-25T12:51:08.413972+0000","last_active":"2024-04-25T12:51:08.413949+0000","last_peered":"2024-04-25T12:51:08.413949+0000","last_clean":"2024-04-25T12:51:08.413949+0000","last_became_active":"2024-04-25T12:50:54.478889+0000","last_became_peered":"2024-04-25T12:50:54.478889+0000","last_unstale":"2024-04-25T12:51:08.413949+0000","last_undegraded":"2024-04-25T12:51:08.413949+0000","last_fullsized":"2024-04-25T12:51:08.413949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.413863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.413863+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.413863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:07.595956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"27'12","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.375434+0000","last_change":"2024-04-25T12:51:01.375462+0000","last_active":"2024-04-25T12:51:01.375434+0000","last_peered":"2024-04-25T12:51:01.375434+0000","last_clean":"2024-04-25T12:51:01.375434+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:51:01.375434+0000","last_undegraded":"2024-04-25T12:51:01.375434+0000","last_fullsized":"2024-04-25T12:51:01.375434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-25T12:51:01.375373+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-25T12:51:01.375373+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.375373+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:28.538902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.698940+0000","last_change":"2024-04-25T12:51:13.698972+0000","last_active":"2024-04-25T12:51:13.698940+0000","last_peered":"2024-04-25T12:51:13.698940+0000","last_clean":"2024-04-25T12:51:13.698940+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:51:13.698940+0000","last_undegraded":"2024-04-25T12:51:13.698940+0000","last_fullsized":"2024-04-25T12:51:13.698940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.698845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.698845+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.698845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:29.407264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.074978+0000","last_change":"2024-04-25T12:51:14.075002+0000","last_active":"2024-04-25T12:51:14.074978+0000","last_peered":"2024-04-25T12:51:14.074978+0000","last_clean":"2024-04-25T12:51:14.074978+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:51:14.074978+0000","last_undegraded":"2024-04-25T12:51:14.074978+0000","last_fullsized":"2024-04-25T12:51:14.074978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.074873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.074873+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.074873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:44.758369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.925512+0000","last_change":"2024-04-25T12:51:03.925567+0000","last_active":"2024-04-25T12:51:03.925512+0000","last_peered":"2024-04-25T12:51:03.925512+0000","last_clean":"2024-04-25T12:51:03.925512+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:51:03.925512+0000","last_undegraded":"2024-04-25T12:51:03.925512+0000","last_fullsized":"2024-04-25T12:51:03.925512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.925415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.925415+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.925415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:02.459307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:19.387166+0000","last_change":"2024-04-25T12:51:19.387205+0000","last_active":"2024-04-25T12:51:19.387166+0000","last_peered":"2024-04-25T12:51:19.387166+0000","last_clean":"2024-04-25T12:51:19.387166+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:51:19.387166+0000","last_undegraded":"2024-04-25T12:51:19.387166+0000","last_fullsized":"2024-04-25T12:51:19.387166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:19.387048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:19.387048+0000","last_clean_scrub_stamp":"2024-04-25T12:51:19.387048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:34.110989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.462895+0000","last_change":"2024-04-25T12:51:13.462934+0000","last_active":"2024-04-25T12:51:13.462895+0000","last_peered":"2024-04-25T12:51:13.462895+0000","last_clean":"2024-04-25T12:51:13.462895+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:51:13.462895+0000","last_undegraded":"2024-04-25T12:51:13.462895+0000","last_fullsized":"2024-04-25T12:51:13.462895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.462802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.462802+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.462802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:50.950463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.565416+0000","last_change":"2024-04-25T12:51:07.565438+0000","last_active":"2024-04-25T12:51:07.565416+0000","last_peered":"2024-04-25T12:51:07.565416+0000","last_clean":"2024-04-25T12:51:07.565416+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:51:07.565416+0000","last_undegraded":"2024-04-25T12:51:07.565416+0000","last_fullsized":"2024-04-25T12:51:07.565416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.565323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.565323+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.565323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:20.088360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:18.418843+0000","last_change":"2024-04-25T12:51:18.418868+0000","last_active":"2024-04-25T12:51:18.418843+0000","last_peered":"2024-04-25T12:51:18.418843+0000","last_clean":"2024-04-25T12:51:18.418843+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:51:18.418843+0000","last_undegraded":"2024-04-25T12:51:18.418843+0000","last_fullsized":"2024-04-25T12:51:18.418843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:18.418751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:18.418751+0000","last_clean_scrub_stamp":"2024-04-25T12:51:18.418751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:18.056997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.732744+0000","last_change":"2024-04-25T12:51:08.732769+0000","last_active":"2024-04-25T12:51:08.732744+0000","last_peered":"2024-04-25T12:51:08.732744+0000","last_clean":"2024-04-25T12:51:08.732744+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:51:08.732744+0000","last_undegraded":"2024-04-25T12:51:08.732744+0000","last_fullsized":"2024-04-25T12:51:08.732744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.732654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.732654+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.732654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:55.574478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.677066+0000","last_change":"2024-04-25T12:51:01.677091+0000","last_active":"2024-04-25T12:51:01.677066+0000","last_peered":"2024-04-25T12:51:01.677066+0000","last_clean":"2024-04-25T12:51:01.677066+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:51:01.677066+0000","last_undegraded":"2024-04-25T12:51:01.677066+0000","last_fullsized":"2024-04-25T12:51:01.677066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T12:51:01.677006+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T12:51:01.677006+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.677006+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:03.109426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.574690+0000","last_change":"2024-04-25T12:51:16.574716+0000","last_active":"2024-04-25T12:51:16.574690+0000","last_peered":"2024-04-25T12:51:16.574690+0000","last_clean":"2024-04-25T12:51:16.574690+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:51:16.574690+0000","last_undegraded":"2024-04-25T12:51:16.574690+0000","last_fullsized":"2024-04-25T12:51:16.574690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.574592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.574592+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.574592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:50.732281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:19.566459+0000","last_change":"2024-04-25T12:51:19.566497+0000","last_active":"2024-04-25T12:51:19.566459+0000","last_peered":"2024-04-25T12:51:19.566459+0000","last_clean":"2024-04-25T12:51:19.566459+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:51:19.566459+0000","last_undegraded":"2024-04-25T12:51:19.566459+0000","last_fullsized":"2024-04-25T12:51:19.566459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:19.566339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:19.566339+0000","last_clean_scrub_stamp":"2024-04-25T12:51:19.566339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:21.967222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'14","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.026560+0000","last_change":"2024-04-25T12:51:07.026623+0000","last_active":"2024-04-25T12:51:07.026560+0000","last_peered":"2024-04-25T12:51:07.026560+0000","last_clean":"2024-04-25T12:51:07.026560+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:51:07.026560+0000","last_undegraded":"2024-04-25T12:51:07.026560+0000","last_fullsized":"2024-04-25T12:51:07.026560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-25T12:51:07.026464+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-25T12:51:07.026464+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.026464+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:56.491742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.755709+0000","last_change":"2024-04-25T12:51:14.755736+0000","last_active":"2024-04-25T12:51:14.755709+0000","last_peered":"2024-04-25T12:51:14.755709+0000","last_clean":"2024-04-25T12:51:14.755709+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:51:14.755709+0000","last_undegraded":"2024-04-25T12:51:14.755709+0000","last_fullsized":"2024-04-25T12:51:14.755709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.755629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.755629+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.755629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:11.701571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.780023+0000","last_change":"2024-04-25T12:51:06.780050+0000","last_active":"2024-04-25T12:51:06.780023+0000","last_peered":"2024-04-25T12:51:06.780023+0000","last_clean":"2024-04-25T12:51:06.780023+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:51:06.780023+0000","last_undegraded":"2024-04-25T12:51:06.780023+0000","last_fullsized":"2024-04-25T12:51:06.780023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.779928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.779928+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.779928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:09.602036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.757692+0000","last_change":"2024-04-25T12:51:04.757726+0000","last_active":"2024-04-25T12:51:04.757692+0000","last_peered":"2024-04-25T12:51:04.757692+0000","last_clean":"2024-04-25T12:51:04.757692+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:51:04.757692+0000","last_undegraded":"2024-04-25T12:51:04.757692+0000","last_fullsized":"2024-04-25T12:51:04.757692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T12:51:04.757612+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T12:51:04.757612+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.757612+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:19.095689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.751660+0000","last_change":"2024-04-25T12:51:07.751702+0000","last_active":"2024-04-25T12:51:07.751660+0000","last_peered":"2024-04-25T12:51:07.751660+0000","last_clean":"2024-04-25T12:51:07.751660+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:51:07.751660+0000","last_undegraded":"2024-04-25T12:51:07.751660+0000","last_fullsized":"2024-04-25T12:51:07.751660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.751560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.751560+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.751560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:25.985403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:00.681157+0000","last_change":"2024-04-25T12:51:00.681176+0000","last_active":"2024-04-25T12:51:00.681157+0000","last_peered":"2024-04-25T12:51:00.681157+0000","last_clean":"2024-04-25T12:51:00.681157+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:51:00.681157+0000","last_undegraded":"2024-04-25T12:51:00.681157+0000","last_fullsized":"2024-04-25T12:51:00.681157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:00.681094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:00.681094+0000","last_clean_scrub_stamp":"2024-04-25T12:51:00.681094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:36.781084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.546656+0000","last_change":"2024-04-25T12:51:04.546678+0000","last_active":"2024-04-25T12:51:04.546656+0000","last_peered":"2024-04-25T12:51:04.546656+0000","last_clean":"2024-04-25T12:51:04.546656+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:51:04.546656+0000","last_undegraded":"2024-04-25T12:51:04.546656+0000","last_fullsized":"2024-04-25T12:51:04.546656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.546567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.546567+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.546567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:14.064661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.315862+0000","last_change":"2024-04-25T12:51:15.315899+0000","last_active":"2024-04-25T12:51:15.315862+0000","last_peered":"2024-04-25T12:51:15.315862+0000","last_clean":"2024-04-25T12:51:15.315862+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:51:15.315862+0000","last_undegraded":"2024-04-25T12:51:15.315862+0000","last_fullsized":"2024-04-25T12:51:15.315862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.315766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.315766+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.315766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.604809+0000","last_change":"2024-04-25T12:51:15.604833+0000","last_active":"2024-04-25T12:51:15.604809+0000","last_peered":"2024-04-25T12:51:15.604809+0000","last_clean":"2024-04-25T12:51:15.604809+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:51:15.604809+0000","last_undegraded":"2024-04-25T12:51:15.604809+0000","last_fullsized":"2024-04-25T12:51:15.604809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.604734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.604734+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.604734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:53.487612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.004594+0000","last_change":"2024-04-25T12:51:06.004618+0000","last_active":"2024-04-25T12:51:06.004594+0000","last_peered":"2024-04-25T12:51:06.004594+0000","last_clean":"2024-04-25T12:51:06.004594+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:51:06.004594+0000","last_undegraded":"2024-04-25T12:51:06.004594+0000","last_fullsized":"2024-04-25T12:51:06.004594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.004512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.004512+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.004512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:58.259136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:50:54.599612+0000","last_change":"2024-04-25T12:50:17.400377+0000","last_active":"2024-04-25T12:50:54.599612+0000","last_peered":"2024-04-25T12:50:54.599612+0000","last_clean":"2024-04-25T12:50:54.599612+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:50:54.599612+0000","last_undegraded":"2024-04-25T12:50:54.599612+0000","last_fullsized":"2024-04-25T12:50:54.599612+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:50:16.360429+0000","last_clean_scrub_stamp":"2024-04-25T12:50:16.360429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.708404+0000","last_change":"2024-04-25T12:51:14.708448+0000","last_active":"2024-04-25T12:51:14.708404+0000","last_peered":"2024-04-25T12:51:14.708404+0000","last_clean":"2024-04-25T12:51:14.708404+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:51:14.708404+0000","last_undegraded":"2024-04-25T12:51:14.708404+0000","last_fullsized":"2024-04-25T12:51:14.708404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.708287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.708287+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.708287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:46.612174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:00.805249+0000","last_change":"2024-04-25T12:51:00.805268+0000","last_active":"2024-04-25T12:51:00.805249+0000","last_peered":"2024-04-25T12:51:00.805249+0000","last_clean":"2024-04-25T12:51:00.805249+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:51:00.805249+0000","last_undegraded":"2024-04-25T12:51:00.805249+0000","last_fullsized":"2024-04-25T12:51:00.805249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:00.805183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:00.805183+0000","last_clean_scrub_stamp":"2024-04-25T12:51:00.805183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:25.469245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.597420+0000","last_change":"2024-04-25T12:51:06.597450+0000","last_active":"2024-04-25T12:51:06.597420+0000","last_peered":"2024-04-25T12:51:06.597420+0000","last_clean":"2024-04-25T12:51:06.597420+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:51:06.597420+0000","last_undegraded":"2024-04-25T12:51:06.597420+0000","last_fullsized":"2024-04-25T12:51:06.597420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.597328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.597328+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.597328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:15.345235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.080298+0000","last_change":"2024-04-25T12:51:15.080323+0000","last_active":"2024-04-25T12:51:15.080298+0000","last_peered":"2024-04-25T12:51:15.080298+0000","last_clean":"2024-04-25T12:51:15.080298+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:51:15.080298+0000","last_undegraded":"2024-04-25T12:51:15.080298+0000","last_fullsized":"2024-04-25T12:51:15.080298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.080216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.080216+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.080216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:23.540330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.298735+0000","last_change":"2024-04-25T12:51:05.298783+0000","last_active":"2024-04-25T12:51:05.298735+0000","last_peered":"2024-04-25T12:51:05.298735+0000","last_clean":"2024-04-25T12:51:05.298735+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:51:05.298735+0000","last_undegraded":"2024-04-25T12:51:05.298735+0000","last_fullsized":"2024-04-25T12:51:05.298735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.298638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.298638+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.298638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:02.991978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.309444+0000","last_change":"2024-04-25T12:51:07.309470+0000","last_active":"2024-04-25T12:51:07.309444+0000","last_peered":"2024-04-25T12:51:07.309444+0000","last_clean":"2024-04-25T12:51:07.309444+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:51:07.309444+0000","last_undegraded":"2024-04-25T12:51:07.309444+0000","last_fullsized":"2024-04-25T12:51:07.309444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.309360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.309360+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.309360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:46.691013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.974679+0000","last_change":"2024-04-25T12:51:04.974704+0000","last_active":"2024-04-25T12:51:04.974679+0000","last_peered":"2024-04-25T12:51:04.974679+0000","last_clean":"2024-04-25T12:51:04.974679+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:51:04.974679+0000","last_undegraded":"2024-04-25T12:51:04.974679+0000","last_fullsized":"2024-04-25T12:51:04.974679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T12:51:04.974587+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T12:51:04.974587+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.974587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:59.417881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.744279+0000","last_change":"2024-04-25T12:51:06.744304+0000","last_active":"2024-04-25T12:51:06.744279+0000","last_peered":"2024-04-25T12:51:06.744279+0000","last_clean":"2024-04-25T12:51:06.744279+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:51:06.744279+0000","last_undegraded":"2024-04-25T12:51:06.744279+0000","last_fullsized":"2024-04-25T12:51:06.744279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.744203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.744203+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.744203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:33.542689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.380244+0000","last_change":"2024-04-25T12:51:07.380272+0000","last_active":"2024-04-25T12:51:07.380244+0000","last_peered":"2024-04-25T12:51:07.380244+0000","last_clean":"2024-04-25T12:51:07.380244+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:51:07.380244+0000","last_undegraded":"2024-04-25T12:51:07.380244+0000","last_fullsized":"2024-04-25T12:51:07.380244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.380155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.380155+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.380155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:19.344797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.314943+0000","last_change":"2024-04-25T12:51:08.314969+0000","last_active":"2024-04-25T12:51:08.314943+0000","last_peered":"2024-04-25T12:51:08.314943+0000","last_clean":"2024-04-25T12:51:08.314943+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:51:08.314943+0000","last_undegraded":"2024-04-25T12:51:08.314943+0000","last_fullsized":"2024-04-25T12:51:08.314943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T12:51:08.314840+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T12:51:08.314840+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.314840+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:07.777049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.768953+0000","last_change":"2024-04-25T12:51:04.768990+0000","last_active":"2024-04-25T12:51:04.768953+0000","last_peered":"2024-04-25T12:51:04.768953+0000","last_clean":"2024-04-25T12:51:04.768953+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:51:04.768953+0000","last_undegraded":"2024-04-25T12:51:04.768953+0000","last_fullsized":"2024-04-25T12:51:04.768953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.768874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.768874+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.768874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:18.665210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.363644+0000","last_change":"2024-04-25T12:51:16.363667+0000","last_active":"2024-04-25T12:51:16.363644+0000","last_peered":"2024-04-25T12:51:16.363644+0000","last_clean":"2024-04-25T12:51:16.363644+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:51:16.363644+0000","last_undegraded":"2024-04-25T12:51:16.363644+0000","last_fullsized":"2024-04-25T12:51:16.363644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.363554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.363554+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.363554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:45.296791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.076817+0000","last_change":"2024-04-25T12:51:13.076842+0000","last_active":"2024-04-25T12:51:13.076817+0000","last_peered":"2024-04-25T12:51:13.076817+0000","last_clean":"2024-04-25T12:51:13.076817+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:51:13.076817+0000","last_undegraded":"2024-04-25T12:51:13.076817+0000","last_fullsized":"2024-04-25T12:51:13.076817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.076718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.076718+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.076718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:39.535077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.341001+0000","last_change":"2024-04-25T12:51:06.341026+0000","last_active":"2024-04-25T12:51:06.341001+0000","last_peered":"2024-04-25T12:51:06.341001+0000","last_clean":"2024-04-25T12:51:06.341001+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:51:06.341001+0000","last_undegraded":"2024-04-25T12:51:06.341001+0000","last_fullsized":"2024-04-25T12:51:06.341001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.340913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.340913+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.340913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.027704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:18.617206+0000","last_change":"2024-04-25T12:51:18.617230+0000","last_active":"2024-04-25T12:51:18.617206+0000","last_peered":"2024-04-25T12:51:18.617206+0000","last_clean":"2024-04-25T12:51:18.617206+0000","last_became_active":"2024-04-25T12:50:54.602588+0000","last_became_peered":"2024-04-25T12:50:54.602588+0000","last_unstale":"2024-04-25T12:51:18.617206+0000","last_undegraded":"2024-04-25T12:51:18.617206+0000","last_fullsized":"2024-04-25T12:51:18.617206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:18.617117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:18.617117+0000","last_clean_scrub_stamp":"2024-04-25T12:51:18.617117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:50.726275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.784629+0000","last_change":"2024-04-25T12:51:05.784657+0000","last_active":"2024-04-25T12:51:05.784629+0000","last_peered":"2024-04-25T12:51:05.784629+0000","last_clean":"2024-04-25T12:51:05.784629+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:51:05.784629+0000","last_undegraded":"2024-04-25T12:51:05.784629+0000","last_fullsized":"2024-04-25T12:51:05.784629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.784544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.784544+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.784544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:51.961686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.354342+0000","last_change":"2024-04-25T12:51:11.354366+0000","last_active":"2024-04-25T12:51:11.354342+0000","last_peered":"2024-04-25T12:51:11.354342+0000","last_clean":"2024-04-25T12:51:11.354342+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:51:11.354342+0000","last_undegraded":"2024-04-25T12:51:11.354342+0000","last_fullsized":"2024-04-25T12:51:11.354342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.354255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.354255+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.354255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:18.614993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.788906+0000","last_change":"2024-04-25T12:51:08.788932+0000","last_active":"2024-04-25T12:51:08.788906+0000","last_peered":"2024-04-25T12:51:08.788906+0000","last_clean":"2024-04-25T12:51:08.788906+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:51:08.788906+0000","last_undegraded":"2024-04-25T12:51:08.788906+0000","last_fullsized":"2024-04-25T12:51:08.788906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.788802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.788802+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.788802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:52.533204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.988983+0000","last_change":"2024-04-25T12:51:09.989007+0000","last_active":"2024-04-25T12:51:09.988983+0000","last_peered":"2024-04-25T12:51:09.988983+0000","last_clean":"2024-04-25T12:51:09.988983+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:51:09.988983+0000","last_undegraded":"2024-04-25T12:51:09.988983+0000","last_fullsized":"2024-04-25T12:51:09.988983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.988856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.988856+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.988856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:50.483401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.315153+0000","last_change":"2024-04-25T12:51:13.315178+0000","last_active":"2024-04-25T12:51:13.315153+0000","last_peered":"2024-04-25T12:51:13.315153+0000","last_clean":"2024-04-25T12:51:13.315153+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:51:13.315153+0000","last_undegraded":"2024-04-25T12:51:13.315153+0000","last_fullsized":"2024-04-25T12:51:13.315153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.315068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.315068+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.315068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:20.768055+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.616815+0000","last_change":"2024-04-25T12:51:13.616851+0000","last_active":"2024-04-25T12:51:13.616815+0000","last_peered":"2024-04-25T12:51:13.616815+0000","last_clean":"2024-04-25T12:51:13.616815+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:51:13.616815+0000","last_undegraded":"2024-04-25T12:51:13.616815+0000","last_fullsized":"2024-04-25T12:51:13.616815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.616703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.616703+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.616703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:26.827982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.324307+0000","last_change":"2024-04-25T12:51:14.324342+0000","last_active":"2024-04-25T12:51:14.324307+0000","last_peered":"2024-04-25T12:51:14.324307+0000","last_clean":"2024-04-25T12:51:14.324307+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:51:14.324307+0000","last_undegraded":"2024-04-25T12:51:14.324307+0000","last_fullsized":"2024-04-25T12:51:14.324307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.324221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.324221+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.324221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:56.361171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.399325+0000","last_change":"2024-04-25T12:51:10.399364+0000","last_active":"2024-04-25T12:51:10.399325+0000","last_peered":"2024-04-25T12:51:10.399325+0000","last_clean":"2024-04-25T12:51:10.399325+0000","last_became_active":"2024-04-25T12:50:54.600590+0000","last_became_peered":"2024-04-25T12:50:54.600590+0000","last_unstale":"2024-04-25T12:51:10.399325+0000","last_undegraded":"2024-04-25T12:51:10.399325+0000","last_fullsized":"2024-04-25T12:51:10.399325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.399217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.399217+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.399217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:18.469289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.677672+0000","last_change":"2024-04-25T12:51:10.677715+0000","last_active":"2024-04-25T12:51:10.677672+0000","last_peered":"2024-04-25T12:51:10.677672+0000","last_clean":"2024-04-25T12:51:10.677672+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:51:10.677672+0000","last_undegraded":"2024-04-25T12:51:10.677672+0000","last_fullsized":"2024-04-25T12:51:10.677672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.677583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.677583+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.677583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:31.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.999005+0000","last_change":"2024-04-25T12:51:08.999033+0000","last_active":"2024-04-25T12:51:08.999005+0000","last_peered":"2024-04-25T12:51:08.999005+0000","last_clean":"2024-04-25T12:51:08.999005+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:51:08.999005+0000","last_undegraded":"2024-04-25T12:51:08.999005+0000","last_fullsized":"2024-04-25T12:51:08.999005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.998914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.998914+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.998914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:58.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.473170+0000","last_change":"2024-04-25T12:51:12.473209+0000","last_active":"2024-04-25T12:51:12.473170+0000","last_peered":"2024-04-25T12:51:12.473170+0000","last_clean":"2024-04-25T12:51:12.473170+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:51:12.473170+0000","last_undegraded":"2024-04-25T12:51:12.473170+0000","last_fullsized":"2024-04-25T12:51:12.473170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.473066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.473066+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.473066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:38.024010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.358198+0000","last_change":"2024-04-25T12:51:05.358227+0000","last_active":"2024-04-25T12:51:05.358198+0000","last_peered":"2024-04-25T12:51:05.358198+0000","last_clean":"2024-04-25T12:51:05.358198+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:51:05.358198+0000","last_undegraded":"2024-04-25T12:51:05.358198+0000","last_fullsized":"2024-04-25T12:51:05.358198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.358104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.358104+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.358104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:22.989337+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.575078+0000","last_change":"2024-04-25T12:51:14.575115+0000","last_active":"2024-04-25T12:51:14.575078+0000","last_peered":"2024-04-25T12:51:14.575078+0000","last_clean":"2024-04-25T12:51:14.575078+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:51:14.575078+0000","last_undegraded":"2024-04-25T12:51:14.575078+0000","last_fullsized":"2024-04-25T12:51:14.575078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.574976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.574976+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.574976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:07.070088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.366896+0000","last_change":"2024-04-25T12:51:09.366921+0000","last_active":"2024-04-25T12:51:09.366896+0000","last_peered":"2024-04-25T12:51:09.366896+0000","last_clean":"2024-04-25T12:51:09.366896+0000","last_became_active":"2024-04-25T12:50:54.481059+0000","last_became_peered":"2024-04-25T12:50:54.481059+0000","last_unstale":"2024-04-25T12:51:09.366896+0000","last_undegraded":"2024-04-25T12:51:09.366896+0000","last_fullsized":"2024-04-25T12:51:09.366896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.366803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.366803+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.366803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:08.526046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.745814+0000","last_change":"2024-04-25T12:51:07.745853+0000","last_active":"2024-04-25T12:51:07.745814+0000","last_peered":"2024-04-25T12:51:07.745814+0000","last_clean":"2024-04-25T12:51:07.745814+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:51:07.745814+0000","last_undegraded":"2024-04-25T12:51:07.745814+0000","last_fullsized":"2024-04-25T12:51:07.745814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.745696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.745696+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.745696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.978837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.743143+0000","last_change":"2024-04-25T12:51:03.743162+0000","last_active":"2024-04-25T12:51:03.743143+0000","last_peered":"2024-04-25T12:51:03.743143+0000","last_clean":"2024-04-25T12:51:03.743143+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:51:03.743143+0000","last_undegraded":"2024-04-25T12:51:03.743143+0000","last_fullsized":"2024-04-25T12:51:03.743143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.743077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.743077+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.743077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:54.249438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.338523+0000","last_change":"2024-04-25T12:51:10.338551+0000","last_active":"2024-04-25T12:51:10.338523+0000","last_peered":"2024-04-25T12:51:10.338523+0000","last_clean":"2024-04-25T12:51:10.338523+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:51:10.338523+0000","last_undegraded":"2024-04-25T12:51:10.338523+0000","last_fullsized":"2024-04-25T12:51:10.338523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.338420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.338420+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.338420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:35.494802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.784351+0000","last_change":"2024-04-25T12:51:02.784377+0000","last_active":"2024-04-25T12:51:02.784351+0000","last_peered":"2024-04-25T12:51:02.784351+0000","last_clean":"2024-04-25T12:51:02.784351+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:51:02.784351+0000","last_undegraded":"2024-04-25T12:51:02.784351+0000","last_fullsized":"2024-04-25T12:51:02.784351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.784255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.784255+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.784255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:59.674215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.063846+0000","last_change":"2024-04-25T12:51:12.063877+0000","last_active":"2024-04-25T12:51:12.063846+0000","last_peered":"2024-04-25T12:51:12.063846+0000","last_clean":"2024-04-25T12:51:12.063846+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:51:12.063846+0000","last_undegraded":"2024-04-25T12:51:12.063846+0000","last_fullsized":"2024-04-25T12:51:12.063846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.063765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.063765+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.063765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:48.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.037273+0000","last_change":"2024-04-25T12:51:11.037300+0000","last_active":"2024-04-25T12:51:11.037273+0000","last_peered":"2024-04-25T12:51:11.037273+0000","last_clean":"2024-04-25T12:51:11.037273+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:51:11.037273+0000","last_undegraded":"2024-04-25T12:51:11.037273+0000","last_fullsized":"2024-04-25T12:51:11.037273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.037191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.037191+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.037191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:34.997919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.563804+0000","last_change":"2024-04-25T12:51:17.563825+0000","last_active":"2024-04-25T12:51:17.563804+0000","last_peered":"2024-04-25T12:51:17.563804+0000","last_clean":"2024-04-25T12:51:17.563804+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:51:17.563804+0000","last_undegraded":"2024-04-25T12:51:17.563804+0000","last_fullsized":"2024-04-25T12:51:17.563804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.563724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.563724+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.563724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:42.404722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.297900+0000","last_change":"2024-04-25T12:51:04.297936+0000","last_active":"2024-04-25T12:51:04.297900+0000","last_peered":"2024-04-25T12:51:04.297900+0000","last_clean":"2024-04-25T12:51:04.297900+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:51:04.297900+0000","last_undegraded":"2024-04-25T12:51:04.297900+0000","last_fullsized":"2024-04-25T12:51:04.297900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.297771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.297771+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.297771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:06.227516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.531980+0000","last_change":"2024-04-25T12:51:15.532005+0000","last_active":"2024-04-25T12:51:15.531980+0000","last_peered":"2024-04-25T12:51:15.531980+0000","last_clean":"2024-04-25T12:51:15.531980+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:51:15.531980+0000","last_undegraded":"2024-04-25T12:51:15.531980+0000","last_fullsized":"2024-04-25T12:51:15.531980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.531883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.531883+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.531883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:14.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.556625+0000","last_change":"2024-04-25T12:51:11.556651+0000","last_active":"2024-04-25T12:51:11.556625+0000","last_peered":"2024-04-25T12:51:11.556625+0000","last_clean":"2024-04-25T12:51:11.556625+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:51:11.556625+0000","last_undegraded":"2024-04-25T12:51:11.556625+0000","last_fullsized":"2024-04-25T12:51:11.556625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.556523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.556523+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.556523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:17.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.497684+0000","last_change":"2024-04-25T12:51:03.497710+0000","last_active":"2024-04-25T12:51:03.497684+0000","last_peered":"2024-04-25T12:51:03.497684+0000","last_clean":"2024-04-25T12:51:03.497684+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:51:03.497684+0000","last_undegraded":"2024-04-25T12:51:03.497684+0000","last_fullsized":"2024-04-25T12:51:03.497684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.497599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.497599+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.497599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:52.648912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.515700+0000","last_change":"2024-04-25T12:51:08.515727+0000","last_active":"2024-04-25T12:51:08.515700+0000","last_peered":"2024-04-25T12:51:08.515700+0000","last_clean":"2024-04-25T12:51:08.515700+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:51:08.515700+0000","last_undegraded":"2024-04-25T12:51:08.515700+0000","last_fullsized":"2024-04-25T12:51:08.515700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.515599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.515599+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.515599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:28.906494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.732835+0000","last_change":"2024-04-25T12:51:07.732861+0000","last_active":"2024-04-25T12:51:07.732835+0000","last_peered":"2024-04-25T12:51:07.732835+0000","last_clean":"2024-04-25T12:51:07.732835+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:51:07.732835+0000","last_undegraded":"2024-04-25T12:51:07.732835+0000","last_fullsized":"2024-04-25T12:51:07.732835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.732726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.732726+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.732726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:25.771129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.756861+0000","last_change":"2024-04-25T12:51:11.756895+0000","last_active":"2024-04-25T12:51:11.756861+0000","last_peered":"2024-04-25T12:51:11.756861+0000","last_clean":"2024-04-25T12:51:11.756861+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:51:11.756861+0000","last_undegraded":"2024-04-25T12:51:11.756861+0000","last_fullsized":"2024-04-25T12:51:11.756861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.756787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.756787+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.756787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:50.207174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.480182+0000","last_change":"2024-04-25T12:51:11.480226+0000","last_active":"2024-04-25T12:51:11.480182+0000","last_peered":"2024-04-25T12:51:11.480182+0000","last_clean":"2024-04-25T12:51:11.480182+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:51:11.480182+0000","last_undegraded":"2024-04-25T12:51:11.480182+0000","last_fullsized":"2024-04-25T12:51:11.480182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.480083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.480083+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.480083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.588932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5037,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542164,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":709565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":884736,"data_stored":709509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574868,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":122798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574866,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":118649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":118685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":122798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":118559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:51:23.442 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:23.444 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T12:50:16.360429+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=12, tm_min=50, tm_sec=58, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T12:51:23.444 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T12:51:40.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:40.318 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:43.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T12:51:43.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.556+0000 7f33bcd95640 1 Processor -- start 2024-04-25T12:51:43.554 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.556+0000 7f33bcd95640 1 -- start start 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33bcd95640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33b8151fa0 0x7f33b8157e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33bcd95640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b815bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33bcd95640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33b815b500 con 0x7f33b80c4cc0 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33bcd95640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f33b815bae0 con 0x7f33b8151fa0 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33bcd95640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f33b80c52f0 con 0x7f33b8152380 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33b8151fa0 0x7f33b8157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.557 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f33b80c4cc0 0x7f33b80c8940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34164/0 (socket says 172.21.15.132:34164) 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b6d9d640 1 -- 172.21.15.132:0/943773031 learned_addr learned my addr 172.21.15.132:0/943773031 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33affff640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b815bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b659c640 1 -- 172.21.15.132:0/943773031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 msgr2=0x7f33b815bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b659c640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b815bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b659c640 1 -- 172.21.15.132:0/943773031 >> v1:172.21.15.132:6789/0 conn(0x7f33b80c4cc0 legacy=0x7f33b80c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b659c640 1 -- 172.21.15.132:0/943773031 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b80c55d0 con 0x7f33b8151fa0 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33b5d9b640 1 -- 172.21.15.132:0/943773031 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935582409 0 0) 0x7f33b815b500 con 0x7f33b80c4cc0 2024-04-25T12:51:43.558 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.557+0000 7f33affff640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.558+0000 7f33b659c640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8151fa0 0x7f33b8157e70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33a80097a0 tx=0x7f33a802a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d886018b2cd73c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.558+0000 7f33b5d9b640 1 -- 172.21.15.132:0/943773031 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8037070 con 0x7f33b8151fa0 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.558+0000 7f33b5d9b640 1 -- 172.21.15.132:0/943773031 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8032440 con 0x7f33b8151fa0 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.558+0000 7f33b5d9b640 1 -- 172.21.15.132:0/943773031 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8032810 con 0x7f33b8151fa0 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 -- 172.21.15.132:0/943773031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8151fa0 msgr2=0x7f33b8157e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8151fa0 0x7f33b8157e70 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f33a80097a0 tx=0x7f33a802a180 comp rx=0 tx=0).stop 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 -- 172.21.15.132:0/943773031 shutdown_connections 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b815bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.559 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 --2- 172.21.15.132:0/943773031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b8151fa0 0x7f33b8157e70 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 -- 172.21.15.132:0/943773031 >> 172.21.15.132:0/943773031 conn(0x7f33b8067630 msgr2=0x7f33b8067a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:43.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 -- 172.21.15.132:0/943773031 shutdown_connections 2024-04-25T12:51:43.560 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.559+0000 7f33bcd95640 1 -- 172.21.15.132:0/943773031 wait complete. 2024-04-25T12:51:43.562 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.560+0000 7f33bcd95640 1 Processor -- start 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.560+0000 7f33bcd95640 1 -- start start 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 0x7f33b8154b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33b8151fa0 0x7f33b81627f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80c3bc0 con 0x7f33b80c4cc0 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f33b80c58b0 con 0x7f33b8151fa0 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f33b80c9150 con 0x7f33b8152380 2024-04-25T12:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 0x7f33b8154b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 0x7f33b8154b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59110/0 (socket says 172.21.15.132:59110) 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 -- 172.21.15.132:0/1409881946 learned_addr learned my addr 172.21.15.132:0/1409881946 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33affff640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33b8151fa0 0x7f33b81627f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b6d9d640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 -- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 msgr2=0x7f33b80cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b80cc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 -- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33b8151fa0 msgr2=0x7f33b81627f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33b8151fa0 0x7f33b81627f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 -- 172.21.15.132:0/1409881946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33b81f51d0 con 0x7f33b80c4cc0 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33affff640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33b8151fa0 0x7f33b81627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b6d9d640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33b659c640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 0x7f33b8154b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f33a8035040 tx=0x7f33a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8037050 con 0x7f33b80c4cc0 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33a8038040 con 0x7f33b80c4cc0 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33b8149de0 con 0x7f33b80c4cc0 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.561+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a8004490 con 0x7f33b80c4cc0 2024-04-25T12:51:43.565 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.562+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33b814a3a0 con 0x7f33b80c4cc0 2024-04-25T12:51:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.563+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33b8068c20 con 0x7f33b80c4cc0 2024-04-25T12:51:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.563+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f33a8030980 con 0x7f33b80c4cc0 2024-04-25T12:51:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.563+0000 7f33aeffd640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f339806c8f0 0x7f339806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.564+0000 7f33affff640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f339806c8f0 0x7f339806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.564+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f33a80acbd0 con 0x7f33b80c4cc0 2024-04-25T12:51:43.566 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.564+0000 7f33affff640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f339806c8f0 0x7f339806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33b80cd570 tx=0x7f33a0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:43.567 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.568+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f33a807ab60 con 0x7f33b80c4cc0 2024-04-25T12:51:43.738 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.741+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 --> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f33b8155040 con 0x7f339806c8f0 2024-04-25T12:51:43.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.748+0000 7f33aeffd640 1 -- 172.21.15.132:0/1409881946 <== mgr.4104 v2:172.21.15.132:6832/1781084722 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332594 (secure 0 0 0) 0x7f33a000a210 con 0x7f339806c8f0 2024-04-25T12:51:43.749 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:51:43.751 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f339806c8f0 msgr2=0x7f339806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f339806c8f0 0x7f339806edb0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f33b80cd570 tx=0x7f33a0008040 comp rx=0 tx=0).stop 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 msgr2=0x7f33b8154b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 0x7f33b8154b00 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f33a8035040 tx=0x7f33a80046c0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 shutdown_connections 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f339806c8f0 0x7f339806edb0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f33b8152380 0x7f33b80cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f33b8151fa0 0x7f33b81627f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.753 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.751+0000 7f33bcd95640 1 --2- 172.21.15.132:0/1409881946 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33b80c4cc0 0x7f33b8154b00 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.752+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 >> 172.21.15.132:0/1409881946 conn(0x7f33b8067630 msgr2=0x7f33b80c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.752+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 shutdown_connections 2024-04-25T12:51:43.754 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.752+0000 7f33bcd95640 1 -- 172.21.15.132:0/1409881946 wait complete. 2024-04-25T12:51:43.760 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":72,"stamp":"2024-04-25T12:51:43.149265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595405,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":210,"num_write_kb":2437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":184,"ondisk_log_size":184,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236232,"kb_used_data":3464,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738488,"statfs":{"total":773094113280,"available":772852211712,"internally_reserved":0,"allocated":3547136,"data_stored":2139282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":238276146},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004054"},"pg_stats":[{"pgid":"2.1f","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.723055+0000","last_change":"2024-04-25T12:51:02.723080+0000","last_active":"2024-04-25T12:51:02.723055+0000","last_peered":"2024-04-25T12:51:02.723055+0000","last_clean":"2024-04-25T12:51:02.723055+0000","last_became_active":"2024-04-25T12:50:12.349745+0000","last_became_peered":"2024-04-25T12:50:12.349745+0000","last_unstale":"2024-04-25T12:51:02.723055+0000","last_undegraded":"2024-04-25T12:51:02.723055+0000","last_fullsized":"2024-04-25T12:51:02.723055+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-04-25T12:51:02.722999+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-04-25T12:51:02.722999+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.722999+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:39.859559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.337930+0000","last_change":"2024-04-25T12:51:09.337954+0000","last_active":"2024-04-25T12:51:09.337930+0000","last_peered":"2024-04-25T12:51:09.337930+0000","last_clean":"2024-04-25T12:51:09.337930+0000","last_became_active":"2024-04-25T12:50:13.354309+0000","last_became_peered":"2024-04-25T12:50:13.354309+0000","last_unstale":"2024-04-25T12:51:09.337930+0000","last_undegraded":"2024-04-25T12:51:09.337930+0000","last_fullsized":"2024-04-25T12:51:09.337930+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.337827+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.337827+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.337827+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:08:13.114476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:20.367845+0000","last_change":"2024-04-25T12:51:20.367868+0000","last_active":"2024-04-25T12:51:20.367845+0000","last_peered":"2024-04-25T12:51:20.367845+0000","last_clean":"2024-04-25T12:51:20.367845+0000","last_became_active":"2024-04-25T12:50:17.399741+0000","last_became_peered":"2024-04-25T12:50:17.399741+0000","last_unstale":"2024-04-25T12:51:20.367845+0000","last_undegraded":"2024-04-25T12:51:20.367845+0000","last_fullsized":"2024-04-25T12:51:20.367845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:20.367756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:20.367756+0000","last_clean_scrub_stamp":"2024-04-25T12:51:20.367756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:22:08.095812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.309148+0000","last_change":"2024-04-25T12:51:06.309173+0000","last_active":"2024-04-25T12:51:06.309148+0000","last_peered":"2024-04-25T12:51:06.309148+0000","last_clean":"2024-04-25T12:51:06.309148+0000","last_became_active":"2024-04-25T12:50:12.353727+0000","last_became_peered":"2024-04-25T12:50:12.353727+0000","last_unstale":"2024-04-25T12:51:06.309148+0000","last_undegraded":"2024-04-25T12:51:06.309148+0000","last_fullsized":"2024-04-25T12:51:06.309148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T12:51:06.309059+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T12:51:06.309059+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.309059+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:06:49.904702+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.740487+0000","last_change":"2024-04-25T12:51:16.740512+0000","last_active":"2024-04-25T12:51:16.740487+0000","last_peered":"2024-04-25T12:51:16.740487+0000","last_clean":"2024-04-25T12:51:16.740487+0000","last_became_active":"2024-04-25T12:50:54.602420+0000","last_became_peered":"2024-04-25T12:50:54.602420+0000","last_unstale":"2024-04-25T12:51:16.740487+0000","last_undegraded":"2024-04-25T12:51:16.740487+0000","last_fullsized":"2024-04-25T12:51:16.740487+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.740403+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.740403+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.740403+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:08.848769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.722547+0000","last_change":"2024-04-25T12:51:09.722614+0000","last_active":"2024-04-25T12:51:09.722547+0000","last_peered":"2024-04-25T12:51:09.722547+0000","last_clean":"2024-04-25T12:51:09.722547+0000","last_became_active":"2024-04-25T12:50:17.390734+0000","last_became_peered":"2024-04-25T12:50:17.390734+0000","last_unstale":"2024-04-25T12:51:09.722547+0000","last_undegraded":"2024-04-25T12:51:09.722547+0000","last_fullsized":"2024-04-25T12:51:09.722547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.722446+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.722446+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.722446+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:15:08.029364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.481805+0000","last_change":"2024-04-25T12:51:05.481834+0000","last_active":"2024-04-25T12:51:05.481805+0000","last_peered":"2024-04-25T12:51:05.481805+0000","last_clean":"2024-04-25T12:51:05.481805+0000","last_became_active":"2024-04-25T12:50:12.345600+0000","last_became_peered":"2024-04-25T12:50:12.345600+0000","last_unstale":"2024-04-25T12:51:05.481805+0000","last_undegraded":"2024-04-25T12:51:05.481805+0000","last_fullsized":"2024-04-25T12:51:05.481805+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:05.481719+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:05.481719+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.481719+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:57:30.274725+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.546731+0000","last_change":"2024-04-25T12:51:09.546752+0000","last_active":"2024-04-25T12:51:09.546731+0000","last_peered":"2024-04-25T12:51:09.546731+0000","last_clean":"2024-04-25T12:51:09.546731+0000","last_became_active":"2024-04-25T12:50:13.360816+0000","last_became_peered":"2024-04-25T12:50:13.360816+0000","last_unstale":"2024-04-25T12:51:09.546731+0000","last_undegraded":"2024-04-25T12:51:09.546731+0000","last_fullsized":"2024-04-25T12:51:09.546731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.546642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.546642+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.546642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:18:39.976498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.749172+0000","last_change":"2024-04-25T12:51:08.749199+0000","last_active":"2024-04-25T12:51:08.749172+0000","last_peered":"2024-04-25T12:51:08.749172+0000","last_clean":"2024-04-25T12:51:08.749172+0000","last_became_active":"2024-04-25T12:50:17.390505+0000","last_became_peered":"2024-04-25T12:50:17.390505+0000","last_unstale":"2024-04-25T12:51:08.749172+0000","last_undegraded":"2024-04-25T12:51:08.749172+0000","last_fullsized":"2024-04-25T12:51:08.749172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.749083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.749083+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.749083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:56.692869+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.522777+0000","last_change":"2024-04-25T12:51:08.522824+0000","last_active":"2024-04-25T12:51:08.522777+0000","last_peered":"2024-04-25T12:51:08.522777+0000","last_clean":"2024-04-25T12:51:08.522777+0000","last_became_active":"2024-04-25T12:50:12.350663+0000","last_became_peered":"2024-04-25T12:50:12.350663+0000","last_unstale":"2024-04-25T12:51:08.522777+0000","last_undegraded":"2024-04-25T12:51:08.522777+0000","last_fullsized":"2024-04-25T12:51:08.522777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:08.522658+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:08.522658+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.522658+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:08.103301+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.541925+0000","last_change":"2024-04-25T12:51:10.541962+0000","last_active":"2024-04-25T12:51:10.541925+0000","last_peered":"2024-04-25T12:51:10.541925+0000","last_clean":"2024-04-25T12:51:10.541925+0000","last_became_active":"2024-04-25T12:50:13.360053+0000","last_became_peered":"2024-04-25T12:50:13.360053+0000","last_unstale":"2024-04-25T12:51:10.541925+0000","last_undegraded":"2024-04-25T12:51:10.541925+0000","last_fullsized":"2024-04-25T12:51:10.541925+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.541812+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.541812+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.541812+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:15:12.848210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.685727+0000","last_change":"2024-04-25T12:51:11.685756+0000","last_active":"2024-04-25T12:51:11.685727+0000","last_peered":"2024-04-25T12:51:11.685727+0000","last_clean":"2024-04-25T12:51:11.685727+0000","last_became_active":"2024-04-25T12:50:17.396528+0000","last_became_peered":"2024-04-25T12:50:17.396528+0000","last_unstale":"2024-04-25T12:51:11.685727+0000","last_undegraded":"2024-04-25T12:51:11.685727+0000","last_fullsized":"2024-04-25T12:51:11.685727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.685645+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.685645+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.685645+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:55:56.563212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.000092+0000","last_change":"2024-04-25T12:51:08.000121+0000","last_active":"2024-04-25T12:51:08.000092+0000","last_peered":"2024-04-25T12:51:08.000092+0000","last_clean":"2024-04-25T12:51:08.000092+0000","last_became_active":"2024-04-25T12:50:13.356376+0000","last_became_peered":"2024-04-25T12:50:13.356376+0000","last_unstale":"2024-04-25T12:51:08.000092+0000","last_undegraded":"2024-04-25T12:51:08.000092+0000","last_fullsized":"2024-04-25T12:51:08.000092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.000012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.000012+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.000012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:18:24.048897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.570684+0000","last_change":"2024-04-25T12:51:07.570737+0000","last_active":"2024-04-25T12:51:07.570684+0000","last_peered":"2024-04-25T12:51:07.570684+0000","last_clean":"2024-04-25T12:51:07.570684+0000","last_became_active":"2024-04-25T12:50:12.347940+0000","last_became_peered":"2024-04-25T12:50:12.347940+0000","last_unstale":"2024-04-25T12:51:07.570684+0000","last_undegraded":"2024-04-25T12:51:07.570684+0000","last_fullsized":"2024-04-25T12:51:07.570684+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:07.570586+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:07.570586+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.570586+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:04:30.995424+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.667390+0000","last_change":"2024-04-25T12:51:12.667417+0000","last_active":"2024-04-25T12:51:12.667390+0000","last_peered":"2024-04-25T12:51:12.667390+0000","last_clean":"2024-04-25T12:51:12.667390+0000","last_became_active":"2024-04-25T12:50:17.396807+0000","last_became_peered":"2024-04-25T12:50:17.396807+0000","last_unstale":"2024-04-25T12:51:12.667390+0000","last_undegraded":"2024-04-25T12:51:12.667390+0000","last_fullsized":"2024-04-25T12:51:12.667390+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.667310+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.667310+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.667310+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:13:02.308909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.380427+0000","last_change":"2024-04-25T12:51:01.380460+0000","last_active":"2024-04-25T12:51:01.380427+0000","last_peered":"2024-04-25T12:51:01.380427+0000","last_clean":"2024-04-25T12:51:01.380427+0000","last_became_active":"2024-04-25T12:50:13.360806+0000","last_became_peered":"2024-04-25T12:50:13.360806+0000","last_unstale":"2024-04-25T12:51:01.380427+0000","last_undegraded":"2024-04-25T12:51:01.380427+0000","last_fullsized":"2024-04-25T12:51:01.380427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:01.380337+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:01.380337+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.380337+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:31:34.283147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.715626+0000","last_change":"2024-04-25T12:51:06.715651+0000","last_active":"2024-04-25T12:51:06.715626+0000","last_peered":"2024-04-25T12:51:06.715626+0000","last_clean":"2024-04-25T12:51:06.715626+0000","last_became_active":"2024-04-25T12:50:12.356428+0000","last_became_peered":"2024-04-25T12:50:12.356428+0000","last_unstale":"2024-04-25T12:51:06.715626+0000","last_undegraded":"2024-04-25T12:51:06.715626+0000","last_fullsized":"2024-04-25T12:51:06.715626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.715544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.715544+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.715544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:19:56.405048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.606855+0000","last_change":"2024-04-25T12:51:14.606883+0000","last_active":"2024-04-25T12:51:14.606855+0000","last_peered":"2024-04-25T12:51:14.606855+0000","last_clean":"2024-04-25T12:51:14.606855+0000","last_became_active":"2024-04-25T12:50:54.601163+0000","last_became_peered":"2024-04-25T12:50:54.601163+0000","last_unstale":"2024-04-25T12:51:14.606855+0000","last_undegraded":"2024-04-25T12:51:14.606855+0000","last_fullsized":"2024-04-25T12:51:14.606855+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.606771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.606771+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.606771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:55:25.831629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,2],"acting":[4,3,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.329329+0000","last_change":"2024-04-25T12:51:12.329353+0000","last_active":"2024-04-25T12:51:12.329329+0000","last_peered":"2024-04-25T12:51:12.329329+0000","last_clean":"2024-04-25T12:51:12.329329+0000","last_became_active":"2024-04-25T12:50:13.357744+0000","last_became_peered":"2024-04-25T12:50:13.357744+0000","last_unstale":"2024-04-25T12:51:12.329329+0000","last_undegraded":"2024-04-25T12:51:12.329329+0000","last_fullsized":"2024-04-25T12:51:12.329329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.329238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.329238+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.329238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:23:49.992747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.738516+0000","last_change":"2024-04-25T12:51:03.738539+0000","last_active":"2024-04-25T12:51:03.738516+0000","last_peered":"2024-04-25T12:51:03.738516+0000","last_clean":"2024-04-25T12:51:03.738516+0000","last_became_active":"2024-04-25T12:50:12.344184+0000","last_became_peered":"2024-04-25T12:50:12.344184+0000","last_unstale":"2024-04-25T12:51:03.738516+0000","last_undegraded":"2024-04-25T12:51:03.738516+0000","last_fullsized":"2024-04-25T12:51:03.738516+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.738444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.738444+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.738444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:08:26.813101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.732483+0000","last_change":"2024-04-25T12:51:16.732509+0000","last_active":"2024-04-25T12:51:16.732483+0000","last_peered":"2024-04-25T12:51:16.732483+0000","last_clean":"2024-04-25T12:51:16.732483+0000","last_became_active":"2024-04-25T12:50:17.398358+0000","last_became_peered":"2024-04-25T12:50:17.398358+0000","last_unstale":"2024-04-25T12:51:16.732483+0000","last_undegraded":"2024-04-25T12:51:16.732483+0000","last_fullsized":"2024-04-25T12:51:16.732483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.732391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.732391+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.732391+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:41:17.402606+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.805704+0000","last_change":"2024-04-25T12:51:05.805728+0000","last_active":"2024-04-25T12:51:05.805704+0000","last_peered":"2024-04-25T12:51:05.805704+0000","last_clean":"2024-04-25T12:51:05.805704+0000","last_became_active":"2024-04-25T12:50:13.359500+0000","last_became_peered":"2024-04-25T12:50:13.359500+0000","last_unstale":"2024-04-25T12:51:05.805704+0000","last_undegraded":"2024-04-25T12:51:05.805704+0000","last_fullsized":"2024-04-25T12:51:05.805704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.805623+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.805623+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.805623+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:01:00.245909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.492918+0000","last_change":"2024-04-25T12:51:10.492942+0000","last_active":"2024-04-25T12:51:10.492918+0000","last_peered":"2024-04-25T12:51:10.492918+0000","last_clean":"2024-04-25T12:51:10.492918+0000","last_became_active":"2024-04-25T12:50:12.351673+0000","last_became_peered":"2024-04-25T12:50:12.351673+0000","last_unstale":"2024-04-25T12:51:10.492918+0000","last_undegraded":"2024-04-25T12:51:10.492918+0000","last_fullsized":"2024-04-25T12:51:10.492918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.492831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.492831+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.492831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:47.481864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.677025+0000","last_change":"2024-04-25T12:51:10.677070+0000","last_active":"2024-04-25T12:51:10.677025+0000","last_peered":"2024-04-25T12:51:10.677025+0000","last_clean":"2024-04-25T12:51:10.677025+0000","last_became_active":"2024-04-25T12:50:17.392351+0000","last_became_peered":"2024-04-25T12:50:17.392351+0000","last_unstale":"2024-04-25T12:51:10.677025+0000","last_undegraded":"2024-04-25T12:51:10.677025+0000","last_fullsized":"2024-04-25T12:51:10.677025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.676917+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.676917+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.676917+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:28:14.169189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.782150+0000","last_change":"2024-04-25T12:51:04.782192+0000","last_active":"2024-04-25T12:51:04.782150+0000","last_peered":"2024-04-25T12:51:04.782150+0000","last_clean":"2024-04-25T12:51:04.782150+0000","last_became_active":"2024-04-25T12:50:13.358605+0000","last_became_peered":"2024-04-25T12:50:13.358605+0000","last_unstale":"2024-04-25T12:51:04.782150+0000","last_undegraded":"2024-04-25T12:51:04.782150+0000","last_fullsized":"2024-04-25T12:51:04.782150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.782025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.782025+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.782025+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:03:43.044316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.942943+0000","last_change":"2024-04-25T12:51:02.942982+0000","last_active":"2024-04-25T12:51:02.942943+0000","last_peered":"2024-04-25T12:51:02.942943+0000","last_clean":"2024-04-25T12:51:02.942943+0000","last_became_active":"2024-04-25T12:50:12.347177+0000","last_became_peered":"2024-04-25T12:50:12.347177+0000","last_unstale":"2024-04-25T12:51:02.942943+0000","last_undegraded":"2024-04-25T12:51:02.942943+0000","last_fullsized":"2024-04-25T12:51:02.942943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:02.942866+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:02.942866+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.942866+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:30.066511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.654285+0000","last_change":"2024-04-25T12:51:13.654323+0000","last_active":"2024-04-25T12:51:13.654285+0000","last_peered":"2024-04-25T12:51:13.654285+0000","last_clean":"2024-04-25T12:51:13.654285+0000","last_became_active":"2024-04-25T12:50:17.398253+0000","last_became_peered":"2024-04-25T12:50:17.398253+0000","last_unstale":"2024-04-25T12:51:13.654285+0000","last_undegraded":"2024-04-25T12:51:13.654285+0000","last_fullsized":"2024-04-25T12:51:13.654285+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.654181+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.654181+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.654181+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:55.620316+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.321039+0000","last_change":"2024-04-25T12:51:03.321079+0000","last_active":"2024-04-25T12:51:03.321039+0000","last_peered":"2024-04-25T12:51:03.321039+0000","last_clean":"2024-04-25T12:51:03.321039+0000","last_became_active":"2024-04-25T12:50:13.360505+0000","last_became_peered":"2024-04-25T12:50:13.360505+0000","last_unstale":"2024-04-25T12:51:03.321039+0000","last_undegraded":"2024-04-25T12:51:03.321039+0000","last_fullsized":"2024-04-25T12:51:03.321039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.320957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.320957+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.320957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:07:41.364621+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.747475+0000","last_change":"2024-04-25T12:51:02.747498+0000","last_active":"2024-04-25T12:51:02.747475+0000","last_peered":"2024-04-25T12:51:02.747475+0000","last_clean":"2024-04-25T12:51:02.747475+0000","last_became_active":"2024-04-25T12:50:12.343944+0000","last_became_peered":"2024-04-25T12:50:12.343944+0000","last_unstale":"2024-04-25T12:51:02.747475+0000","last_undegraded":"2024-04-25T12:51:02.747475+0000","last_fullsized":"2024-04-25T12:51:02.747475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T12:51:02.747410+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T12:51:02.747410+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.747410+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:50.868791+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.392389+0000","last_change":"2024-04-25T12:51:17.392419+0000","last_active":"2024-04-25T12:51:17.392389+0000","last_peered":"2024-04-25T12:51:17.392389+0000","last_clean":"2024-04-25T12:51:17.392389+0000","last_became_active":"2024-04-25T12:50:17.395283+0000","last_became_peered":"2024-04-25T12:50:17.395283+0000","last_unstale":"2024-04-25T12:51:17.392389+0000","last_undegraded":"2024-04-25T12:51:17.392389+0000","last_fullsized":"2024-04-25T12:51:17.392389+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.392300+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.392300+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.392300+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:19:54.712390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.817076+0000","last_change":"2024-04-25T12:51:09.817104+0000","last_active":"2024-04-25T12:51:09.817076+0000","last_peered":"2024-04-25T12:51:09.817076+0000","last_clean":"2024-04-25T12:51:09.817076+0000","last_became_active":"2024-04-25T12:50:13.356071+0000","last_became_peered":"2024-04-25T12:50:13.356071+0000","last_unstale":"2024-04-25T12:51:09.817076+0000","last_undegraded":"2024-04-25T12:51:09.817076+0000","last_fullsized":"2024-04-25T12:51:09.817076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.816999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.816999+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.816999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:34:54.865464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.486865+0000","last_change":"2024-04-25T12:51:09.486909+0000","last_active":"2024-04-25T12:51:09.486865+0000","last_peered":"2024-04-25T12:51:09.486865+0000","last_clean":"2024-04-25T12:51:09.486865+0000","last_became_active":"2024-04-25T12:50:12.351637+0000","last_became_peered":"2024-04-25T12:50:12.351637+0000","last_unstale":"2024-04-25T12:51:09.486865+0000","last_undegraded":"2024-04-25T12:51:09.486865+0000","last_fullsized":"2024-04-25T12:51:09.486865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.486764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.486764+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.486764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:51.523713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.685332+0000","last_change":"2024-04-25T12:51:12.685359+0000","last_active":"2024-04-25T12:51:12.685332+0000","last_peered":"2024-04-25T12:51:12.685332+0000","last_clean":"2024-04-25T12:51:12.685332+0000","last_became_active":"2024-04-25T12:50:17.399401+0000","last_became_peered":"2024-04-25T12:50:17.399401+0000","last_unstale":"2024-04-25T12:51:12.685332+0000","last_undegraded":"2024-04-25T12:51:12.685332+0000","last_fullsized":"2024-04-25T12:51:12.685332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.685243+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.685243+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.685243+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:51:02.571712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.492040+0000","last_change":"2024-04-25T12:51:02.492063+0000","last_active":"2024-04-25T12:51:02.492040+0000","last_peered":"2024-04-25T12:51:02.492040+0000","last_clean":"2024-04-25T12:51:02.492040+0000","last_became_active":"2024-04-25T12:50:13.359772+0000","last_became_peered":"2024-04-25T12:50:13.359772+0000","last_unstale":"2024-04-25T12:51:02.492040+0000","last_undegraded":"2024-04-25T12:51:02.492040+0000","last_fullsized":"2024-04-25T12:51:02.492040+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.491950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.491950+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.491950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:26:18.674913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.794376+0000","last_change":"2024-04-25T12:51:01.794395+0000","last_active":"2024-04-25T12:51:01.794376+0000","last_peered":"2024-04-25T12:51:01.794376+0000","last_clean":"2024-04-25T12:51:01.794376+0000","last_became_active":"2024-04-25T12:50:12.343217+0000","last_became_peered":"2024-04-25T12:50:12.343217+0000","last_unstale":"2024-04-25T12:51:01.794376+0000","last_undegraded":"2024-04-25T12:51:01.794376+0000","last_fullsized":"2024-04-25T12:51:01.794376+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:01.794295+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:01.794295+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.794295+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:57:44.703915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.728373+0000","last_change":"2024-04-25T12:51:13.728418+0000","last_active":"2024-04-25T12:51:13.728373+0000","last_peered":"2024-04-25T12:51:13.728373+0000","last_clean":"2024-04-25T12:51:13.728373+0000","last_became_active":"2024-04-25T12:50:17.394700+0000","last_became_peered":"2024-04-25T12:50:17.394700+0000","last_unstale":"2024-04-25T12:51:13.728373+0000","last_undegraded":"2024-04-25T12:51:13.728373+0000","last_fullsized":"2024-04-25T12:51:13.728373+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.728252+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.728252+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.728252+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:53:29.814969+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.756591+0000","last_change":"2024-04-25T12:51:03.756632+0000","last_active":"2024-04-25T12:51:03.756591+0000","last_peered":"2024-04-25T12:51:03.756591+0000","last_clean":"2024-04-25T12:51:03.756591+0000","last_became_active":"2024-04-25T12:50:13.358909+0000","last_became_peered":"2024-04-25T12:50:13.358909+0000","last_unstale":"2024-04-25T12:51:03.756591+0000","last_undegraded":"2024-04-25T12:51:03.756591+0000","last_fullsized":"2024-04-25T12:51:03.756591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.756491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.756491+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.756491+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:45:00.314752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.577388+0000","last_change":"2024-04-25T12:51:05.577433+0000","last_active":"2024-04-25T12:51:05.577388+0000","last_peered":"2024-04-25T12:51:05.577388+0000","last_clean":"2024-04-25T12:51:05.577388+0000","last_became_active":"2024-04-25T12:50:12.351727+0000","last_became_peered":"2024-04-25T12:50:12.351727+0000","last_unstale":"2024-04-25T12:51:05.577388+0000","last_undegraded":"2024-04-25T12:51:05.577388+0000","last_fullsized":"2024-04-25T12:51:05.577388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.577284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.577284+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.577284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:14:09.517481+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.767705+0000","last_change":"2024-04-25T12:51:12.767732+0000","last_active":"2024-04-25T12:51:12.767705+0000","last_peered":"2024-04-25T12:51:12.767705+0000","last_clean":"2024-04-25T12:51:12.767705+0000","last_became_active":"2024-04-25T12:50:17.393302+0000","last_became_peered":"2024-04-25T12:50:17.393302+0000","last_unstale":"2024-04-25T12:51:12.767705+0000","last_undegraded":"2024-04-25T12:51:12.767705+0000","last_fullsized":"2024-04-25T12:51:12.767705+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.767621+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.767621+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.767621+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:29:43.571297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.799388+0000","last_change":"2024-04-25T12:51:10.799414+0000","last_active":"2024-04-25T12:51:10.799388+0000","last_peered":"2024-04-25T12:51:10.799388+0000","last_clean":"2024-04-25T12:51:10.799388+0000","last_became_active":"2024-04-25T12:50:13.356541+0000","last_became_peered":"2024-04-25T12:50:13.356541+0000","last_unstale":"2024-04-25T12:51:10.799388+0000","last_undegraded":"2024-04-25T12:51:10.799388+0000","last_fullsized":"2024-04-25T12:51:10.799388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.799297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.799297+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.799297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:32:10.033758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.394536+0000","last_change":"2024-04-25T12:51:04.394564+0000","last_active":"2024-04-25T12:51:04.394536+0000","last_peered":"2024-04-25T12:51:04.394536+0000","last_clean":"2024-04-25T12:51:04.394536+0000","last_became_active":"2024-04-25T12:50:12.354939+0000","last_became_peered":"2024-04-25T12:50:12.354939+0000","last_unstale":"2024-04-25T12:51:04.394536+0000","last_undegraded":"2024-04-25T12:51:04.394536+0000","last_fullsized":"2024-04-25T12:51:04.394536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.394442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.394442+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.394442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:18.351356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.771332+0000","last_change":"2024-04-25T12:51:15.771359+0000","last_active":"2024-04-25T12:51:15.771332+0000","last_peered":"2024-04-25T12:51:15.771332+0000","last_clean":"2024-04-25T12:51:15.771332+0000","last_became_active":"2024-04-25T12:50:17.394125+0000","last_became_peered":"2024-04-25T12:50:17.394125+0000","last_unstale":"2024-04-25T12:51:15.771332+0000","last_undegraded":"2024-04-25T12:51:15.771332+0000","last_fullsized":"2024-04-25T12:51:15.771332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.771239+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.771239+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.771239+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:14:44.282059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.723527+0000","last_change":"2024-04-25T12:51:09.723554+0000","last_active":"2024-04-25T12:51:09.723527+0000","last_peered":"2024-04-25T12:51:09.723527+0000","last_clean":"2024-04-25T12:51:09.723527+0000","last_became_active":"2024-04-25T12:50:13.364574+0000","last_became_peered":"2024-04-25T12:50:13.364574+0000","last_unstale":"2024-04-25T12:51:09.723527+0000","last_undegraded":"2024-04-25T12:51:09.723527+0000","last_fullsized":"2024-04-25T12:51:09.723527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.723426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.723426+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.723426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:29:39.504056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.527191+0000","last_change":"2024-04-25T12:51:06.527217+0000","last_active":"2024-04-25T12:51:06.527191+0000","last_peered":"2024-04-25T12:51:06.527191+0000","last_clean":"2024-04-25T12:51:06.527191+0000","last_became_active":"2024-04-25T12:50:12.346288+0000","last_became_peered":"2024-04-25T12:50:12.346288+0000","last_unstale":"2024-04-25T12:51:06.527191+0000","last_undegraded":"2024-04-25T12:51:06.527191+0000","last_fullsized":"2024-04-25T12:51:06.527191+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.527093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.527093+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.527093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:32:54.880603+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.755472+0000","last_change":"2024-04-25T12:51:15.755496+0000","last_active":"2024-04-25T12:51:15.755472+0000","last_peered":"2024-04-25T12:51:15.755472+0000","last_clean":"2024-04-25T12:51:15.755472+0000","last_became_active":"2024-04-25T12:50:54.601056+0000","last_became_peered":"2024-04-25T12:50:54.601056+0000","last_unstale":"2024-04-25T12:51:15.755472+0000","last_undegraded":"2024-04-25T12:51:15.755472+0000","last_fullsized":"2024-04-25T12:51:15.755472+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.755389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.755389+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.755389+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:18:19.578345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.360868+0000","last_change":"2024-04-25T12:51:02.360916+0000","last_active":"2024-04-25T12:51:02.360868+0000","last_peered":"2024-04-25T12:51:02.360868+0000","last_clean":"2024-04-25T12:51:02.360868+0000","last_became_active":"2024-04-25T12:50:13.363044+0000","last_became_peered":"2024-04-25T12:50:13.363044+0000","last_unstale":"2024-04-25T12:51:02.360868+0000","last_undegraded":"2024-04-25T12:51:02.360868+0000","last_fullsized":"2024-04-25T12:51:02.360868+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.360788+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.360788+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.360788+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:47:45.845999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.512291+0000","last_change":"2024-04-25T12:51:03.512313+0000","last_active":"2024-04-25T12:51:03.512291+0000","last_peered":"2024-04-25T12:51:03.512291+0000","last_clean":"2024-04-25T12:51:03.512291+0000","last_became_active":"2024-04-25T12:50:12.350179+0000","last_became_peered":"2024-04-25T12:50:12.350179+0000","last_unstale":"2024-04-25T12:51:03.512291+0000","last_undegraded":"2024-04-25T12:51:03.512291+0000","last_fullsized":"2024-04-25T12:51:03.512291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.512194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.512194+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.512194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:22.999616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"27'119","reported_seq":193,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.492515+0000","last_change":"2024-04-25T12:51:04.492547+0000","last_active":"2024-04-25T12:51:04.492515+0000","last_peered":"2024-04-25T12:51:04.492515+0000","last_clean":"2024-04-25T12:51:04.492515+0000","last_became_active":"2024-04-25T12:50:02.341730+0000","last_became_peered":"2024-04-25T12:50:02.341730+0000","last_unstale":"2024-04-25T12:51:04.492515+0000","last_undegraded":"2024-04-25T12:51:04.492515+0000","last_fullsized":"2024-04-25T12:51:04.492515+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'119","last_scrub_stamp":"2024-04-25T12:51:04.492404+0000","last_deep_scrub":"27'119","last_deep_scrub_stamp":"2024-04-25T12:51:04.492404+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.492404+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:38:28.084498+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.059483+0000","last_change":"2024-04-25T12:51:16.059526+0000","last_active":"2024-04-25T12:51:16.059483+0000","last_peered":"2024-04-25T12:51:16.059483+0000","last_clean":"2024-04-25T12:51:16.059483+0000","last_became_active":"2024-04-25T12:50:17.398315+0000","last_became_peered":"2024-04-25T12:50:17.398315+0000","last_unstale":"2024-04-25T12:51:16.059483+0000","last_undegraded":"2024-04-25T12:51:16.059483+0000","last_fullsized":"2024-04-25T12:51:16.059483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.059379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.059379+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.059379+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:00:19.185284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:18.517606+0000","last_change":"2024-04-25T12:51:18.517650+0000","last_active":"2024-04-25T12:51:18.517606+0000","last_peered":"2024-04-25T12:51:18.517606+0000","last_clean":"2024-04-25T12:51:18.517606+0000","last_became_active":"2024-04-25T12:50:13.369574+0000","last_became_peered":"2024-04-25T12:50:13.369574+0000","last_unstale":"2024-04-25T12:51:18.517606+0000","last_undegraded":"2024-04-25T12:51:18.517606+0000","last_fullsized":"2024-04-25T12:51:18.517606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:18.517506+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:18.517506+0000","last_clean_scrub_stamp":"2024-04-25T12:51:18.517506+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:44:26.076937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.402133+0000","last_change":"2024-04-25T12:51:02.402165+0000","last_active":"2024-04-25T12:51:02.402133+0000","last_peered":"2024-04-25T12:51:02.402133+0000","last_clean":"2024-04-25T12:51:02.402133+0000","last_became_active":"2024-04-25T12:50:12.346296+0000","last_became_peered":"2024-04-25T12:50:12.346296+0000","last_unstale":"2024-04-25T12:51:02.402133+0000","last_undegraded":"2024-04-25T12:51:02.402133+0000","last_fullsized":"2024-04-25T12:51:02.402133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.402044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.402044+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.402044+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:51:27.478685+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.053584+0000","last_change":"2024-04-25T12:51:17.053612+0000","last_active":"2024-04-25T12:51:17.053584+0000","last_peered":"2024-04-25T12:51:17.053584+0000","last_clean":"2024-04-25T12:51:17.053584+0000","last_became_active":"2024-04-25T12:50:17.398624+0000","last_became_peered":"2024-04-25T12:50:17.398624+0000","last_unstale":"2024-04-25T12:51:17.053584+0000","last_undegraded":"2024-04-25T12:51:17.053584+0000","last_fullsized":"2024-04-25T12:51:17.053584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.053497+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.053497+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.053497+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:16:22.064749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.568400+0000","last_change":"2024-04-25T12:51:12.568431+0000","last_active":"2024-04-25T12:51:12.568400+0000","last_peered":"2024-04-25T12:51:12.568400+0000","last_clean":"2024-04-25T12:51:12.568400+0000","last_became_active":"2024-04-25T12:50:13.360538+0000","last_became_peered":"2024-04-25T12:50:13.360538+0000","last_unstale":"2024-04-25T12:51:12.568400+0000","last_undegraded":"2024-04-25T12:51:12.568400+0000","last_fullsized":"2024-04-25T12:51:12.568400+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.568303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.568303+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.568303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:48:42.912471+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.738000+0000","last_change":"2024-04-25T12:51:05.738029+0000","last_active":"2024-04-25T12:51:05.738000+0000","last_peered":"2024-04-25T12:51:05.738000+0000","last_clean":"2024-04-25T12:51:05.738000+0000","last_became_active":"2024-04-25T12:50:12.346743+0000","last_became_peered":"2024-04-25T12:50:12.346743+0000","last_unstale":"2024-04-25T12:51:05.738000+0000","last_undegraded":"2024-04-25T12:51:05.738000+0000","last_fullsized":"2024-04-25T12:51:05.738000+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T12:51:05.737920+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T12:51:05.737920+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.737920+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:35:28.901490+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.643041+0000","last_change":"2024-04-25T12:51:11.643067+0000","last_active":"2024-04-25T12:51:11.643041+0000","last_peered":"2024-04-25T12:51:11.643041+0000","last_clean":"2024-04-25T12:51:11.643041+0000","last_became_active":"2024-04-25T12:50:17.394854+0000","last_became_peered":"2024-04-25T12:50:17.394854+0000","last_unstale":"2024-04-25T12:51:11.643041+0000","last_undegraded":"2024-04-25T12:51:11.643041+0000","last_fullsized":"2024-04-25T12:51:11.643041+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.642954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.642954+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.642954+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:40:16.068665+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.491953+0000","last_change":"2024-04-25T12:51:14.491986+0000","last_active":"2024-04-25T12:51:14.491953+0000","last_peered":"2024-04-25T12:51:14.491953+0000","last_clean":"2024-04-25T12:51:14.491953+0000","last_became_active":"2024-04-25T12:50:13.366476+0000","last_became_peered":"2024-04-25T12:50:13.366476+0000","last_unstale":"2024-04-25T12:51:14.491953+0000","last_undegraded":"2024-04-25T12:51:14.491953+0000","last_fullsized":"2024-04-25T12:51:14.491953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.491865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.491865+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.491865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:41:47.006540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.418728+0000","last_change":"2024-04-25T12:51:03.418775+0000","last_active":"2024-04-25T12:51:03.418728+0000","last_peered":"2024-04-25T12:51:03.418728+0000","last_clean":"2024-04-25T12:51:03.418728+0000","last_became_active":"2024-04-25T12:50:12.354006+0000","last_became_peered":"2024-04-25T12:50:12.354006+0000","last_unstale":"2024-04-25T12:51:03.418728+0000","last_undegraded":"2024-04-25T12:51:03.418728+0000","last_fullsized":"2024-04-25T12:51:03.418728+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-04-25T12:51:03.418654+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-04-25T12:51:03.418654+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.418654+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:28:58.826372+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.615142+0000","last_change":"2024-04-25T12:51:17.615169+0000","last_active":"2024-04-25T12:51:17.615142+0000","last_peered":"2024-04-25T12:51:17.615142+0000","last_clean":"2024-04-25T12:51:17.615142+0000","last_became_active":"2024-04-25T12:50:17.399790+0000","last_became_peered":"2024-04-25T12:50:17.399790+0000","last_unstale":"2024-04-25T12:51:17.615142+0000","last_undegraded":"2024-04-25T12:51:17.615142+0000","last_fullsized":"2024-04-25T12:51:17.615142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.615050+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.615050+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.615050+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:41:32.809936+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.516707+0000","last_change":"2024-04-25T12:51:16.516739+0000","last_active":"2024-04-25T12:51:16.516707+0000","last_peered":"2024-04-25T12:51:16.516707+0000","last_clean":"2024-04-25T12:51:16.516707+0000","last_became_active":"2024-04-25T12:50:13.367685+0000","last_became_peered":"2024-04-25T12:50:13.367685+0000","last_unstale":"2024-04-25T12:51:16.516707+0000","last_undegraded":"2024-04-25T12:51:16.516707+0000","last_fullsized":"2024-04-25T12:51:16.516707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.516612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.516612+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.516612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:54:44.872281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"27'2","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.767644+0000","last_change":"2024-04-25T12:51:01.767679+0000","last_active":"2024-04-25T12:51:01.767644+0000","last_peered":"2024-04-25T12:51:01.767644+0000","last_clean":"2024-04-25T12:51:01.767644+0000","last_became_active":"2024-04-25T12:50:12.342648+0000","last_became_peered":"2024-04-25T12:50:12.342648+0000","last_unstale":"2024-04-25T12:51:01.767644+0000","last_undegraded":"2024-04-25T12:51:01.767644+0000","last_fullsized":"2024-04-25T12:51:01.767644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-04-25T12:51:01.767555+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-04-25T12:51:01.767555+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.767555+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:13:32.612163+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.599810+0000","last_change":"2024-04-25T12:51:15.599867+0000","last_active":"2024-04-25T12:51:15.599810+0000","last_peered":"2024-04-25T12:51:15.599810+0000","last_clean":"2024-04-25T12:51:15.599810+0000","last_became_active":"2024-04-25T12:50:54.601336+0000","last_became_peered":"2024-04-25T12:50:54.601336+0000","last_unstale":"2024-04-25T12:51:15.599810+0000","last_undegraded":"2024-04-25T12:51:15.599810+0000","last_fullsized":"2024-04-25T12:51:15.599810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.599709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.599709+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.599709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:10:26.335500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,3,6],"acting":[4,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.413949+0000","last_change":"2024-04-25T12:51:08.413972+0000","last_active":"2024-04-25T12:51:08.413949+0000","last_peered":"2024-04-25T12:51:08.413949+0000","last_clean":"2024-04-25T12:51:08.413949+0000","last_became_active":"2024-04-25T12:50:54.478889+0000","last_became_peered":"2024-04-25T12:50:54.478889+0000","last_unstale":"2024-04-25T12:51:08.413949+0000","last_undegraded":"2024-04-25T12:51:08.413949+0000","last_fullsized":"2024-04-25T12:51:08.413949+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.413863+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.413863+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.413863+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:04:07.595956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.10","version":"27'12","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.375434+0000","last_change":"2024-04-25T12:51:01.375462+0000","last_active":"2024-04-25T12:51:01.375434+0000","last_peered":"2024-04-25T12:51:01.375434+0000","last_clean":"2024-04-25T12:51:01.375434+0000","last_became_active":"2024-04-25T12:50:12.343475+0000","last_became_peered":"2024-04-25T12:50:12.343475+0000","last_unstale":"2024-04-25T12:51:01.375434+0000","last_undegraded":"2024-04-25T12:51:01.375434+0000","last_fullsized":"2024-04-25T12:51:01.375434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-04-25T12:51:01.375373+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-04-25T12:51:01.375373+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.375373+0000","objects_scrubbed":4,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:24:28.538902+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.698940+0000","last_change":"2024-04-25T12:51:13.698972+0000","last_active":"2024-04-25T12:51:13.698940+0000","last_peered":"2024-04-25T12:51:13.698940+0000","last_clean":"2024-04-25T12:51:13.698940+0000","last_became_active":"2024-04-25T12:50:17.399036+0000","last_became_peered":"2024-04-25T12:50:17.399036+0000","last_unstale":"2024-04-25T12:51:13.698940+0000","last_undegraded":"2024-04-25T12:51:13.698940+0000","last_fullsized":"2024-04-25T12:51:13.698940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.698845+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.698845+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.698845+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:50:29.407264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.074978+0000","last_change":"2024-04-25T12:51:14.075002+0000","last_active":"2024-04-25T12:51:14.074978+0000","last_peered":"2024-04-25T12:51:14.074978+0000","last_clean":"2024-04-25T12:51:14.074978+0000","last_became_active":"2024-04-25T12:50:13.364476+0000","last_became_peered":"2024-04-25T12:50:13.364476+0000","last_unstale":"2024-04-25T12:51:14.074978+0000","last_undegraded":"2024-04-25T12:51:14.074978+0000","last_fullsized":"2024-04-25T12:51:14.074978+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.074873+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.074873+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.074873+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:21:44.758369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.925512+0000","last_change":"2024-04-25T12:51:03.925567+0000","last_active":"2024-04-25T12:51:03.925512+0000","last_peered":"2024-04-25T12:51:03.925512+0000","last_clean":"2024-04-25T12:51:03.925512+0000","last_became_active":"2024-04-25T12:50:12.347637+0000","last_became_peered":"2024-04-25T12:50:12.347637+0000","last_unstale":"2024-04-25T12:51:03.925512+0000","last_undegraded":"2024-04-25T12:51:03.925512+0000","last_fullsized":"2024-04-25T12:51:03.925512+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.925415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.925415+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.925415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:05:02.459307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:19.387166+0000","last_change":"2024-04-25T12:51:19.387205+0000","last_active":"2024-04-25T12:51:19.387166+0000","last_peered":"2024-04-25T12:51:19.387166+0000","last_clean":"2024-04-25T12:51:19.387166+0000","last_became_active":"2024-04-25T12:50:17.398896+0000","last_became_peered":"2024-04-25T12:50:17.398896+0000","last_unstale":"2024-04-25T12:51:19.387166+0000","last_undegraded":"2024-04-25T12:51:19.387166+0000","last_fullsized":"2024-04-25T12:51:19.387166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:19.387048+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:19.387048+0000","last_clean_scrub_stamp":"2024-04-25T12:51:19.387048+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:35:34.110989+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.462895+0000","last_change":"2024-04-25T12:51:13.462934+0000","last_active":"2024-04-25T12:51:13.462895+0000","last_peered":"2024-04-25T12:51:13.462895+0000","last_clean":"2024-04-25T12:51:13.462895+0000","last_became_active":"2024-04-25T12:50:13.364622+0000","last_became_peered":"2024-04-25T12:50:13.364622+0000","last_unstale":"2024-04-25T12:51:13.462895+0000","last_undegraded":"2024-04-25T12:51:13.462895+0000","last_fullsized":"2024-04-25T12:51:13.462895+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.462802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.462802+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.462802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:29:50.950463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.565416+0000","last_change":"2024-04-25T12:51:07.565438+0000","last_active":"2024-04-25T12:51:07.565416+0000","last_peered":"2024-04-25T12:51:07.565416+0000","last_clean":"2024-04-25T12:51:07.565416+0000","last_became_active":"2024-04-25T12:50:12.356295+0000","last_became_peered":"2024-04-25T12:50:12.356295+0000","last_unstale":"2024-04-25T12:51:07.565416+0000","last_undegraded":"2024-04-25T12:51:07.565416+0000","last_fullsized":"2024-04-25T12:51:07.565416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.565323+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.565323+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.565323+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:01:20.088360+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:18.418843+0000","last_change":"2024-04-25T12:51:18.418868+0000","last_active":"2024-04-25T12:51:18.418843+0000","last_peered":"2024-04-25T12:51:18.418843+0000","last_clean":"2024-04-25T12:51:18.418843+0000","last_became_active":"2024-04-25T12:50:17.396362+0000","last_became_peered":"2024-04-25T12:50:17.396362+0000","last_unstale":"2024-04-25T12:51:18.418843+0000","last_undegraded":"2024-04-25T12:51:18.418843+0000","last_fullsized":"2024-04-25T12:51:18.418843+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:18.418751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:18.418751+0000","last_clean_scrub_stamp":"2024-04-25T12:51:18.418751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:18.056997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.732744+0000","last_change":"2024-04-25T12:51:08.732769+0000","last_active":"2024-04-25T12:51:08.732744+0000","last_peered":"2024-04-25T12:51:08.732744+0000","last_clean":"2024-04-25T12:51:08.732744+0000","last_became_active":"2024-04-25T12:50:13.362265+0000","last_became_peered":"2024-04-25T12:50:13.362265+0000","last_unstale":"2024-04-25T12:51:08.732744+0000","last_undegraded":"2024-04-25T12:51:08.732744+0000","last_fullsized":"2024-04-25T12:51:08.732744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.732654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.732654+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.732654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:11:55.574478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"27'4","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:01.677066+0000","last_change":"2024-04-25T12:51:01.677091+0000","last_active":"2024-04-25T12:51:01.677066+0000","last_peered":"2024-04-25T12:51:01.677066+0000","last_clean":"2024-04-25T12:51:01.677066+0000","last_became_active":"2024-04-25T12:50:12.347883+0000","last_became_peered":"2024-04-25T12:50:12.347883+0000","last_unstale":"2024-04-25T12:51:01.677066+0000","last_undegraded":"2024-04-25T12:51:01.677066+0000","last_fullsized":"2024-04-25T12:51:01.677066+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-04-25T12:51:01.677006+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-04-25T12:51:01.677006+0000","last_clean_scrub_stamp":"2024-04-25T12:51:01.677006+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:11:03.109426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.574690+0000","last_change":"2024-04-25T12:51:16.574716+0000","last_active":"2024-04-25T12:51:16.574690+0000","last_peered":"2024-04-25T12:51:16.574690+0000","last_clean":"2024-04-25T12:51:16.574690+0000","last_became_active":"2024-04-25T12:50:17.399748+0000","last_became_peered":"2024-04-25T12:50:17.399748+0000","last_unstale":"2024-04-25T12:51:16.574690+0000","last_undegraded":"2024-04-25T12:51:16.574690+0000","last_fullsized":"2024-04-25T12:51:16.574690+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.574592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.574592+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.574592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:59:50.732281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:19.566459+0000","last_change":"2024-04-25T12:51:19.566497+0000","last_active":"2024-04-25T12:51:19.566459+0000","last_peered":"2024-04-25T12:51:19.566459+0000","last_clean":"2024-04-25T12:51:19.566459+0000","last_became_active":"2024-04-25T12:50:13.369923+0000","last_became_peered":"2024-04-25T12:50:13.369923+0000","last_unstale":"2024-04-25T12:51:19.566459+0000","last_undegraded":"2024-04-25T12:51:19.566459+0000","last_fullsized":"2024-04-25T12:51:19.566459+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:19.566339+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:19.566339+0000","last_clean_scrub_stamp":"2024-04-25T12:51:19.566339+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:58:21.967222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"27'14","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.026560+0000","last_change":"2024-04-25T12:51:07.026623+0000","last_active":"2024-04-25T12:51:07.026560+0000","last_peered":"2024-04-25T12:51:07.026560+0000","last_clean":"2024-04-25T12:51:07.026560+0000","last_became_active":"2024-04-25T12:50:12.354059+0000","last_became_peered":"2024-04-25T12:50:12.354059+0000","last_unstale":"2024-04-25T12:51:07.026560+0000","last_undegraded":"2024-04-25T12:51:07.026560+0000","last_fullsized":"2024-04-25T12:51:07.026560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'14","last_scrub_stamp":"2024-04-25T12:51:07.026464+0000","last_deep_scrub":"27'14","last_deep_scrub_stamp":"2024-04-25T12:51:07.026464+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.026464+0000","objects_scrubbed":4,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:56.491742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.755709+0000","last_change":"2024-04-25T12:51:14.755736+0000","last_active":"2024-04-25T12:51:14.755709+0000","last_peered":"2024-04-25T12:51:14.755709+0000","last_clean":"2024-04-25T12:51:14.755709+0000","last_became_active":"2024-04-25T12:50:17.394212+0000","last_became_peered":"2024-04-25T12:50:17.394212+0000","last_unstale":"2024-04-25T12:51:14.755709+0000","last_undegraded":"2024-04-25T12:51:14.755709+0000","last_fullsized":"2024-04-25T12:51:14.755709+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.755629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.755629+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.755629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:17:11.701571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.780023+0000","last_change":"2024-04-25T12:51:06.780050+0000","last_active":"2024-04-25T12:51:06.780023+0000","last_peered":"2024-04-25T12:51:06.780023+0000","last_clean":"2024-04-25T12:51:06.780023+0000","last_became_active":"2024-04-25T12:50:13.360868+0000","last_became_peered":"2024-04-25T12:50:13.360868+0000","last_unstale":"2024-04-25T12:51:06.780023+0000","last_undegraded":"2024-04-25T12:51:06.780023+0000","last_fullsized":"2024-04-25T12:51:06.780023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.779928+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.779928+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.779928+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:23:09.602036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.757692+0000","last_change":"2024-04-25T12:51:04.757726+0000","last_active":"2024-04-25T12:51:04.757692+0000","last_peered":"2024-04-25T12:51:04.757692+0000","last_clean":"2024-04-25T12:51:04.757692+0000","last_became_active":"2024-04-25T12:50:12.347116+0000","last_became_peered":"2024-04-25T12:50:12.347116+0000","last_unstale":"2024-04-25T12:51:04.757692+0000","last_undegraded":"2024-04-25T12:51:04.757692+0000","last_fullsized":"2024-04-25T12:51:04.757692+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-04-25T12:51:04.757612+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-04-25T12:51:04.757612+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.757612+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:59:19.095689+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.751660+0000","last_change":"2024-04-25T12:51:07.751702+0000","last_active":"2024-04-25T12:51:07.751660+0000","last_peered":"2024-04-25T12:51:07.751660+0000","last_clean":"2024-04-25T12:51:07.751660+0000","last_became_active":"2024-04-25T12:50:17.386913+0000","last_became_peered":"2024-04-25T12:50:17.386913+0000","last_unstale":"2024-04-25T12:51:07.751660+0000","last_undegraded":"2024-04-25T12:51:07.751660+0000","last_fullsized":"2024-04-25T12:51:07.751660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.751560+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.751560+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.751560+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:34:25.985403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:00.681157+0000","last_change":"2024-04-25T12:51:00.681176+0000","last_active":"2024-04-25T12:51:00.681157+0000","last_peered":"2024-04-25T12:51:00.681157+0000","last_clean":"2024-04-25T12:51:00.681157+0000","last_became_active":"2024-04-25T12:50:13.363531+0000","last_became_peered":"2024-04-25T12:50:13.363531+0000","last_unstale":"2024-04-25T12:51:00.681157+0000","last_undegraded":"2024-04-25T12:51:00.681157+0000","last_fullsized":"2024-04-25T12:51:00.681157+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:00.681094+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:00.681094+0000","last_clean_scrub_stamp":"2024-04-25T12:51:00.681094+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:51:36.781084+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.546656+0000","last_change":"2024-04-25T12:51:04.546678+0000","last_active":"2024-04-25T12:51:04.546656+0000","last_peered":"2024-04-25T12:51:04.546656+0000","last_clean":"2024-04-25T12:51:04.546656+0000","last_became_active":"2024-04-25T12:50:12.350761+0000","last_became_peered":"2024-04-25T12:50:12.350761+0000","last_unstale":"2024-04-25T12:51:04.546656+0000","last_undegraded":"2024-04-25T12:51:04.546656+0000","last_fullsized":"2024-04-25T12:51:04.546656+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.546567+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.546567+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.546567+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:14.064661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.315862+0000","last_change":"2024-04-25T12:51:15.315899+0000","last_active":"2024-04-25T12:51:15.315862+0000","last_peered":"2024-04-25T12:51:15.315862+0000","last_clean":"2024-04-25T12:51:15.315862+0000","last_became_active":"2024-04-25T12:50:17.387138+0000","last_became_peered":"2024-04-25T12:50:17.387138+0000","last_unstale":"2024-04-25T12:51:15.315862+0000","last_undegraded":"2024-04-25T12:51:15.315862+0000","last_fullsized":"2024-04-25T12:51:15.315862+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.315766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.315766+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.315766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:31:52.004644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.604809+0000","last_change":"2024-04-25T12:51:15.604833+0000","last_active":"2024-04-25T12:51:15.604809+0000","last_peered":"2024-04-25T12:51:15.604809+0000","last_clean":"2024-04-25T12:51:15.604809+0000","last_became_active":"2024-04-25T12:50:13.369757+0000","last_became_peered":"2024-04-25T12:50:13.369757+0000","last_unstale":"2024-04-25T12:51:15.604809+0000","last_undegraded":"2024-04-25T12:51:15.604809+0000","last_fullsized":"2024-04-25T12:51:15.604809+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.604734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.604734+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.604734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:13:53.487612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.004594+0000","last_change":"2024-04-25T12:51:06.004618+0000","last_active":"2024-04-25T12:51:06.004594+0000","last_peered":"2024-04-25T12:51:06.004594+0000","last_clean":"2024-04-25T12:51:06.004594+0000","last_became_active":"2024-04-25T12:50:12.349879+0000","last_became_peered":"2024-04-25T12:50:12.349879+0000","last_unstale":"2024-04-25T12:51:06.004594+0000","last_undegraded":"2024-04-25T12:51:06.004594+0000","last_fullsized":"2024-04-25T12:51:06.004594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.004512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.004512+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.004512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:35:58.259136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:21.367273+0000","last_change":"2024-04-25T12:51:21.367299+0000","last_active":"2024-04-25T12:51:21.367273+0000","last_peered":"2024-04-25T12:51:21.367273+0000","last_clean":"2024-04-25T12:51:21.367273+0000","last_became_active":"2024-04-25T12:50:17.398229+0000","last_became_peered":"2024-04-25T12:50:17.398229+0000","last_unstale":"2024-04-25T12:51:21.367273+0000","last_undegraded":"2024-04-25T12:51:21.367273+0000","last_fullsized":"2024-04-25T12:51:21.367273+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:21.367166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:21.367166+0000","last_clean_scrub_stamp":"2024-04-25T12:51:21.367166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:30:27.257833+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.708404+0000","last_change":"2024-04-25T12:51:14.708448+0000","last_active":"2024-04-25T12:51:14.708404+0000","last_peered":"2024-04-25T12:51:14.708404+0000","last_clean":"2024-04-25T12:51:14.708404+0000","last_became_active":"2024-04-25T12:50:17.401926+0000","last_became_peered":"2024-04-25T12:50:17.401926+0000","last_unstale":"2024-04-25T12:51:14.708404+0000","last_undegraded":"2024-04-25T12:51:14.708404+0000","last_fullsized":"2024-04-25T12:51:14.708404+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.708287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.708287+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.708287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T17:24:46.612174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:00.805249+0000","last_change":"2024-04-25T12:51:00.805268+0000","last_active":"2024-04-25T12:51:00.805249+0000","last_peered":"2024-04-25T12:51:00.805249+0000","last_clean":"2024-04-25T12:51:00.805249+0000","last_became_active":"2024-04-25T12:50:13.355436+0000","last_became_peered":"2024-04-25T12:50:13.355436+0000","last_unstale":"2024-04-25T12:51:00.805249+0000","last_undegraded":"2024-04-25T12:51:00.805249+0000","last_fullsized":"2024-04-25T12:51:00.805249+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:00.805183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:00.805183+0000","last_clean_scrub_stamp":"2024-04-25T12:51:00.805183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:52:25.469245+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.597420+0000","last_change":"2024-04-25T12:51:06.597450+0000","last_active":"2024-04-25T12:51:06.597420+0000","last_peered":"2024-04-25T12:51:06.597420+0000","last_clean":"2024-04-25T12:51:06.597420+0000","last_became_active":"2024-04-25T12:50:12.353123+0000","last_became_peered":"2024-04-25T12:50:12.353123+0000","last_unstale":"2024-04-25T12:51:06.597420+0000","last_undegraded":"2024-04-25T12:51:06.597420+0000","last_fullsized":"2024-04-25T12:51:06.597420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.597328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.597328+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.597328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:55:15.345235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.080298+0000","last_change":"2024-04-25T12:51:15.080323+0000","last_active":"2024-04-25T12:51:15.080298+0000","last_peered":"2024-04-25T12:51:15.080298+0000","last_clean":"2024-04-25T12:51:15.080298+0000","last_became_active":"2024-04-25T12:50:17.394132+0000","last_became_peered":"2024-04-25T12:50:17.394132+0000","last_unstale":"2024-04-25T12:51:15.080298+0000","last_undegraded":"2024-04-25T12:51:15.080298+0000","last_fullsized":"2024-04-25T12:51:15.080298+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.080216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.080216+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.080216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:11:23.540330+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.298735+0000","last_change":"2024-04-25T12:51:05.298783+0000","last_active":"2024-04-25T12:51:05.298735+0000","last_peered":"2024-04-25T12:51:05.298735+0000","last_clean":"2024-04-25T12:51:05.298735+0000","last_became_active":"2024-04-25T12:50:13.360178+0000","last_became_peered":"2024-04-25T12:50:13.360178+0000","last_unstale":"2024-04-25T12:51:05.298735+0000","last_undegraded":"2024-04-25T12:51:05.298735+0000","last_fullsized":"2024-04-25T12:51:05.298735+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.298638+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.298638+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.298638+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:02.991978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.309444+0000","last_change":"2024-04-25T12:51:07.309470+0000","last_active":"2024-04-25T12:51:07.309444+0000","last_peered":"2024-04-25T12:51:07.309444+0000","last_clean":"2024-04-25T12:51:07.309444+0000","last_became_active":"2024-04-25T12:50:12.353768+0000","last_became_peered":"2024-04-25T12:50:12.353768+0000","last_unstale":"2024-04-25T12:51:07.309444+0000","last_undegraded":"2024-04-25T12:51:07.309444+0000","last_fullsized":"2024-04-25T12:51:07.309444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.309360+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.309360+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.309360+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:45:46.691013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.974679+0000","last_change":"2024-04-25T12:51:04.974704+0000","last_active":"2024-04-25T12:51:04.974679+0000","last_peered":"2024-04-25T12:51:04.974679+0000","last_clean":"2024-04-25T12:51:04.974679+0000","last_became_active":"2024-04-25T12:50:12.347687+0000","last_became_peered":"2024-04-25T12:50:12.347687+0000","last_unstale":"2024-04-25T12:51:04.974679+0000","last_undegraded":"2024-04-25T12:51:04.974679+0000","last_fullsized":"2024-04-25T12:51:04.974679+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T12:51:04.974587+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T12:51:04.974587+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.974587+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:06:59.417881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.744279+0000","last_change":"2024-04-25T12:51:06.744304+0000","last_active":"2024-04-25T12:51:06.744279+0000","last_peered":"2024-04-25T12:51:06.744279+0000","last_clean":"2024-04-25T12:51:06.744279+0000","last_became_active":"2024-04-25T12:50:13.358620+0000","last_became_peered":"2024-04-25T12:50:13.358620+0000","last_unstale":"2024-04-25T12:51:06.744279+0000","last_undegraded":"2024-04-25T12:51:06.744279+0000","last_fullsized":"2024-04-25T12:51:06.744279+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.744203+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.744203+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.744203+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:21:33.542689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.380244+0000","last_change":"2024-04-25T12:51:07.380272+0000","last_active":"2024-04-25T12:51:07.380244+0000","last_peered":"2024-04-25T12:51:07.380244+0000","last_clean":"2024-04-25T12:51:07.380244+0000","last_became_active":"2024-04-25T12:50:17.391342+0000","last_became_peered":"2024-04-25T12:50:17.391342+0000","last_unstale":"2024-04-25T12:51:07.380244+0000","last_undegraded":"2024-04-25T12:51:07.380244+0000","last_fullsized":"2024-04-25T12:51:07.380244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.380155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.380155+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.380155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:25:19.344797+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.314943+0000","last_change":"2024-04-25T12:51:08.314969+0000","last_active":"2024-04-25T12:51:08.314943+0000","last_peered":"2024-04-25T12:51:08.314943+0000","last_clean":"2024-04-25T12:51:08.314943+0000","last_became_active":"2024-04-25T12:50:12.353715+0000","last_became_peered":"2024-04-25T12:50:12.353715+0000","last_unstale":"2024-04-25T12:51:08.314943+0000","last_undegraded":"2024-04-25T12:51:08.314943+0000","last_fullsized":"2024-04-25T12:51:08.314943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'1","last_scrub_stamp":"2024-04-25T12:51:08.314840+0000","last_deep_scrub":"24'1","last_deep_scrub_stamp":"2024-04-25T12:51:08.314840+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.314840+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:27:07.777049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.768953+0000","last_change":"2024-04-25T12:51:04.768990+0000","last_active":"2024-04-25T12:51:04.768953+0000","last_peered":"2024-04-25T12:51:04.768953+0000","last_clean":"2024-04-25T12:51:04.768953+0000","last_became_active":"2024-04-25T12:50:13.359019+0000","last_became_peered":"2024-04-25T12:50:13.359019+0000","last_unstale":"2024-04-25T12:51:04.768953+0000","last_undegraded":"2024-04-25T12:51:04.768953+0000","last_fullsized":"2024-04-25T12:51:04.768953+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.768874+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.768874+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.768874+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:50:18.665210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:16.363644+0000","last_change":"2024-04-25T12:51:16.363667+0000","last_active":"2024-04-25T12:51:16.363644+0000","last_peered":"2024-04-25T12:51:16.363644+0000","last_clean":"2024-04-25T12:51:16.363644+0000","last_became_active":"2024-04-25T12:50:17.393032+0000","last_became_peered":"2024-04-25T12:50:17.393032+0000","last_unstale":"2024-04-25T12:51:16.363644+0000","last_undegraded":"2024-04-25T12:51:16.363644+0000","last_fullsized":"2024-04-25T12:51:16.363644+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:16.363554+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:16.363554+0000","last_clean_scrub_stamp":"2024-04-25T12:51:16.363554+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:43:45.296791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.076817+0000","last_change":"2024-04-25T12:51:13.076842+0000","last_active":"2024-04-25T12:51:13.076817+0000","last_peered":"2024-04-25T12:51:13.076817+0000","last_clean":"2024-04-25T12:51:13.076817+0000","last_became_active":"2024-04-25T12:50:13.366171+0000","last_became_peered":"2024-04-25T12:50:13.366171+0000","last_unstale":"2024-04-25T12:51:13.076817+0000","last_undegraded":"2024-04-25T12:51:13.076817+0000","last_fullsized":"2024-04-25T12:51:13.076817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.076718+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.076718+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.076718+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:44:39.535077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:06.341001+0000","last_change":"2024-04-25T12:51:06.341026+0000","last_active":"2024-04-25T12:51:06.341001+0000","last_peered":"2024-04-25T12:51:06.341001+0000","last_clean":"2024-04-25T12:51:06.341001+0000","last_became_active":"2024-04-25T12:50:13.362705+0000","last_became_peered":"2024-04-25T12:50:13.362705+0000","last_unstale":"2024-04-25T12:51:06.341001+0000","last_undegraded":"2024-04-25T12:51:06.341001+0000","last_fullsized":"2024-04-25T12:51:06.341001+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:06.340913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:06.340913+0000","last_clean_scrub_stamp":"2024-04-25T12:51:06.340913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:43:45.027704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:18.617206+0000","last_change":"2024-04-25T12:51:18.617230+0000","last_active":"2024-04-25T12:51:18.617206+0000","last_peered":"2024-04-25T12:51:18.617206+0000","last_clean":"2024-04-25T12:51:18.617206+0000","last_became_active":"2024-04-25T12:50:54.602588+0000","last_became_peered":"2024-04-25T12:50:54.602588+0000","last_unstale":"2024-04-25T12:51:18.617206+0000","last_undegraded":"2024-04-25T12:51:18.617206+0000","last_fullsized":"2024-04-25T12:51:18.617206+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:18.617117+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:18.617117+0000","last_clean_scrub_stamp":"2024-04-25T12:51:18.617117+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:51:50.726275+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.784629+0000","last_change":"2024-04-25T12:51:05.784657+0000","last_active":"2024-04-25T12:51:05.784629+0000","last_peered":"2024-04-25T12:51:05.784629+0000","last_clean":"2024-04-25T12:51:05.784629+0000","last_became_active":"2024-04-25T12:50:13.358786+0000","last_became_peered":"2024-04-25T12:50:13.358786+0000","last_unstale":"2024-04-25T12:51:05.784629+0000","last_undegraded":"2024-04-25T12:51:05.784629+0000","last_fullsized":"2024-04-25T12:51:05.784629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.784544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.784544+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.784544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:51.961686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.354342+0000","last_change":"2024-04-25T12:51:11.354366+0000","last_active":"2024-04-25T12:51:11.354342+0000","last_peered":"2024-04-25T12:51:11.354342+0000","last_clean":"2024-04-25T12:51:11.354342+0000","last_became_active":"2024-04-25T12:50:13.356145+0000","last_became_peered":"2024-04-25T12:50:13.356145+0000","last_unstale":"2024-04-25T12:51:11.354342+0000","last_undegraded":"2024-04-25T12:51:11.354342+0000","last_fullsized":"2024-04-25T12:51:11.354342+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.354255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.354255+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.354255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:17:18.614993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.788906+0000","last_change":"2024-04-25T12:51:08.788932+0000","last_active":"2024-04-25T12:51:08.788906+0000","last_peered":"2024-04-25T12:51:08.788906+0000","last_clean":"2024-04-25T12:51:08.788906+0000","last_became_active":"2024-04-25T12:50:13.354706+0000","last_became_peered":"2024-04-25T12:50:13.354706+0000","last_unstale":"2024-04-25T12:51:08.788906+0000","last_undegraded":"2024-04-25T12:51:08.788906+0000","last_fullsized":"2024-04-25T12:51:08.788906+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.788802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.788802+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.788802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:49:52.533204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.988983+0000","last_change":"2024-04-25T12:51:09.989007+0000","last_active":"2024-04-25T12:51:09.988983+0000","last_peered":"2024-04-25T12:51:09.988983+0000","last_clean":"2024-04-25T12:51:09.988983+0000","last_became_active":"2024-04-25T12:50:13.362591+0000","last_became_peered":"2024-04-25T12:50:13.362591+0000","last_unstale":"2024-04-25T12:51:09.988983+0000","last_undegraded":"2024-04-25T12:51:09.988983+0000","last_fullsized":"2024-04-25T12:51:09.988983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.988856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.988856+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.988856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:12:50.483401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.315153+0000","last_change":"2024-04-25T12:51:13.315178+0000","last_active":"2024-04-25T12:51:13.315153+0000","last_peered":"2024-04-25T12:51:13.315153+0000","last_clean":"2024-04-25T12:51:13.315153+0000","last_became_active":"2024-04-25T12:50:13.358459+0000","last_became_peered":"2024-04-25T12:50:13.358459+0000","last_unstale":"2024-04-25T12:51:13.315153+0000","last_undegraded":"2024-04-25T12:51:13.315153+0000","last_fullsized":"2024-04-25T12:51:13.315153+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.315068+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.315068+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.315068+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:20.768055+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:13.616815+0000","last_change":"2024-04-25T12:51:13.616851+0000","last_active":"2024-04-25T12:51:13.616815+0000","last_peered":"2024-04-25T12:51:13.616815+0000","last_clean":"2024-04-25T12:51:13.616815+0000","last_became_active":"2024-04-25T12:50:13.363234+0000","last_became_peered":"2024-04-25T12:50:13.363234+0000","last_unstale":"2024-04-25T12:51:13.616815+0000","last_undegraded":"2024-04-25T12:51:13.616815+0000","last_fullsized":"2024-04-25T12:51:13.616815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:13.616703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:13.616703+0000","last_clean_scrub_stamp":"2024-04-25T12:51:13.616703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:36:26.827982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.324307+0000","last_change":"2024-04-25T12:51:14.324342+0000","last_active":"2024-04-25T12:51:14.324307+0000","last_peered":"2024-04-25T12:51:14.324307+0000","last_clean":"2024-04-25T12:51:14.324307+0000","last_became_active":"2024-04-25T12:50:13.364692+0000","last_became_peered":"2024-04-25T12:50:13.364692+0000","last_unstale":"2024-04-25T12:51:14.324307+0000","last_undegraded":"2024-04-25T12:51:14.324307+0000","last_fullsized":"2024-04-25T12:51:14.324307+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.324221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.324221+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.324221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:43:56.361171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.399325+0000","last_change":"2024-04-25T12:51:10.399364+0000","last_active":"2024-04-25T12:51:10.399325+0000","last_peered":"2024-04-25T12:51:10.399325+0000","last_clean":"2024-04-25T12:51:10.399325+0000","last_became_active":"2024-04-25T12:50:54.600590+0000","last_became_peered":"2024-04-25T12:50:54.600590+0000","last_unstale":"2024-04-25T12:51:10.399325+0000","last_undegraded":"2024-04-25T12:51:10.399325+0000","last_fullsized":"2024-04-25T12:51:10.399325+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.399217+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.399217+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.399217+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:14:18.469289+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.677672+0000","last_change":"2024-04-25T12:51:10.677715+0000","last_active":"2024-04-25T12:51:10.677672+0000","last_peered":"2024-04-25T12:51:10.677672+0000","last_clean":"2024-04-25T12:51:10.677672+0000","last_became_active":"2024-04-25T12:50:13.365507+0000","last_became_peered":"2024-04-25T12:50:13.365507+0000","last_unstale":"2024-04-25T12:51:10.677672+0000","last_undegraded":"2024-04-25T12:51:10.677672+0000","last_fullsized":"2024-04-25T12:51:10.677672+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.677583+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.677583+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.677583+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:07:31.271926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.999005+0000","last_change":"2024-04-25T12:51:08.999033+0000","last_active":"2024-04-25T12:51:08.999005+0000","last_peered":"2024-04-25T12:51:08.999005+0000","last_clean":"2024-04-25T12:51:08.999005+0000","last_became_active":"2024-04-25T12:50:13.356992+0000","last_became_peered":"2024-04-25T12:50:13.356992+0000","last_unstale":"2024-04-25T12:51:08.999005+0000","last_undegraded":"2024-04-25T12:51:08.999005+0000","last_fullsized":"2024-04-25T12:51:08.999005+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.998914+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.998914+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.998914+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:55:58.770422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.473170+0000","last_change":"2024-04-25T12:51:12.473209+0000","last_active":"2024-04-25T12:51:12.473170+0000","last_peered":"2024-04-25T12:51:12.473170+0000","last_clean":"2024-04-25T12:51:12.473170+0000","last_became_active":"2024-04-25T12:50:13.365534+0000","last_became_peered":"2024-04-25T12:50:13.365534+0000","last_unstale":"2024-04-25T12:51:12.473170+0000","last_undegraded":"2024-04-25T12:51:12.473170+0000","last_fullsized":"2024-04-25T12:51:12.473170+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.473066+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.473066+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.473066+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T20:06:38.024010+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:05.358198+0000","last_change":"2024-04-25T12:51:05.358227+0000","last_active":"2024-04-25T12:51:05.358198+0000","last_peered":"2024-04-25T12:51:05.358198+0000","last_clean":"2024-04-25T12:51:05.358198+0000","last_became_active":"2024-04-25T12:50:13.352159+0000","last_became_peered":"2024-04-25T12:50:13.352159+0000","last_unstale":"2024-04-25T12:51:05.358198+0000","last_undegraded":"2024-04-25T12:51:05.358198+0000","last_fullsized":"2024-04-25T12:51:05.358198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:05.358104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:05.358104+0000","last_clean_scrub_stamp":"2024-04-25T12:51:05.358104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:19:22.989337+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:14.575078+0000","last_change":"2024-04-25T12:51:14.575115+0000","last_active":"2024-04-25T12:51:14.575078+0000","last_peered":"2024-04-25T12:51:14.575078+0000","last_clean":"2024-04-25T12:51:14.575078+0000","last_became_active":"2024-04-25T12:50:13.369077+0000","last_became_peered":"2024-04-25T12:50:13.369077+0000","last_unstale":"2024-04-25T12:51:14.575078+0000","last_undegraded":"2024-04-25T12:51:14.575078+0000","last_fullsized":"2024-04-25T12:51:14.575078+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:14.574976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:14.574976+0000","last_clean_scrub_stamp":"2024-04-25T12:51:14.574976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:01:07.070088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:09.366896+0000","last_change":"2024-04-25T12:51:09.366921+0000","last_active":"2024-04-25T12:51:09.366896+0000","last_peered":"2024-04-25T12:51:09.366896+0000","last_clean":"2024-04-25T12:51:09.366896+0000","last_became_active":"2024-04-25T12:50:54.481059+0000","last_became_peered":"2024-04-25T12:50:54.481059+0000","last_unstale":"2024-04-25T12:51:09.366896+0000","last_undegraded":"2024-04-25T12:51:09.366896+0000","last_fullsized":"2024-04-25T12:51:09.366896+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:09.366803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:09.366803+0000","last_clean_scrub_stamp":"2024-04-25T12:51:09.366803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:35:08.526046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.745814+0000","last_change":"2024-04-25T12:51:07.745853+0000","last_active":"2024-04-25T12:51:07.745814+0000","last_peered":"2024-04-25T12:51:07.745814+0000","last_clean":"2024-04-25T12:51:07.745814+0000","last_became_active":"2024-04-25T12:50:13.352209+0000","last_became_peered":"2024-04-25T12:50:13.352209+0000","last_unstale":"2024-04-25T12:51:07.745814+0000","last_undegraded":"2024-04-25T12:51:07.745814+0000","last_fullsized":"2024-04-25T12:51:07.745814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.745696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.745696+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.745696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:06:08.978837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.743143+0000","last_change":"2024-04-25T12:51:03.743162+0000","last_active":"2024-04-25T12:51:03.743143+0000","last_peered":"2024-04-25T12:51:03.743143+0000","last_clean":"2024-04-25T12:51:03.743143+0000","last_became_active":"2024-04-25T12:50:13.357564+0000","last_became_peered":"2024-04-25T12:50:13.357564+0000","last_unstale":"2024-04-25T12:51:03.743143+0000","last_undegraded":"2024-04-25T12:51:03.743143+0000","last_fullsized":"2024-04-25T12:51:03.743143+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.743077+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.743077+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.743077+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T22:53:54.249438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:10.338523+0000","last_change":"2024-04-25T12:51:10.338551+0000","last_active":"2024-04-25T12:51:10.338523+0000","last_peered":"2024-04-25T12:51:10.338523+0000","last_clean":"2024-04-25T12:51:10.338523+0000","last_became_active":"2024-04-25T12:50:13.354428+0000","last_became_peered":"2024-04-25T12:50:13.354428+0000","last_unstale":"2024-04-25T12:51:10.338523+0000","last_undegraded":"2024-04-25T12:51:10.338523+0000","last_fullsized":"2024-04-25T12:51:10.338523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:10.338420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:10.338420+0000","last_clean_scrub_stamp":"2024-04-25T12:51:10.338420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:42:35.494802+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:02.784351+0000","last_change":"2024-04-25T12:51:02.784377+0000","last_active":"2024-04-25T12:51:02.784351+0000","last_peered":"2024-04-25T12:51:02.784351+0000","last_clean":"2024-04-25T12:51:02.784351+0000","last_became_active":"2024-04-25T12:50:13.355311+0000","last_became_peered":"2024-04-25T12:50:13.355311+0000","last_unstale":"2024-04-25T12:51:02.784351+0000","last_undegraded":"2024-04-25T12:51:02.784351+0000","last_fullsized":"2024-04-25T12:51:02.784351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:02.784255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:02.784255+0000","last_clean_scrub_stamp":"2024-04-25T12:51:02.784255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:32:59.674215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:12.063846+0000","last_change":"2024-04-25T12:51:12.063877+0000","last_active":"2024-04-25T12:51:12.063846+0000","last_peered":"2024-04-25T12:51:12.063846+0000","last_clean":"2024-04-25T12:51:12.063846+0000","last_became_active":"2024-04-25T12:50:13.365540+0000","last_became_peered":"2024-04-25T12:50:13.365540+0000","last_unstale":"2024-04-25T12:51:12.063846+0000","last_undegraded":"2024-04-25T12:51:12.063846+0000","last_fullsized":"2024-04-25T12:51:12.063846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:12.063765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:12.063765+0000","last_clean_scrub_stamp":"2024-04-25T12:51:12.063765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:37:48.556291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.037273+0000","last_change":"2024-04-25T12:51:11.037300+0000","last_active":"2024-04-25T12:51:11.037273+0000","last_peered":"2024-04-25T12:51:11.037273+0000","last_clean":"2024-04-25T12:51:11.037273+0000","last_became_active":"2024-04-25T12:50:13.364904+0000","last_became_peered":"2024-04-25T12:50:13.364904+0000","last_unstale":"2024-04-25T12:51:11.037273+0000","last_undegraded":"2024-04-25T12:51:11.037273+0000","last_fullsized":"2024-04-25T12:51:11.037273+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.037191+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.037191+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.037191+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:07:34.997919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:17.563804+0000","last_change":"2024-04-25T12:51:17.563825+0000","last_active":"2024-04-25T12:51:17.563804+0000","last_peered":"2024-04-25T12:51:17.563804+0000","last_clean":"2024-04-25T12:51:17.563804+0000","last_became_active":"2024-04-25T12:50:13.369628+0000","last_became_peered":"2024-04-25T12:50:13.369628+0000","last_unstale":"2024-04-25T12:51:17.563804+0000","last_undegraded":"2024-04-25T12:51:17.563804+0000","last_fullsized":"2024-04-25T12:51:17.563804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:17.563724+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:17.563724+0000","last_clean_scrub_stamp":"2024-04-25T12:51:17.563724+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T16:28:42.404722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:04.297900+0000","last_change":"2024-04-25T12:51:04.297936+0000","last_active":"2024-04-25T12:51:04.297900+0000","last_peered":"2024-04-25T12:51:04.297900+0000","last_clean":"2024-04-25T12:51:04.297900+0000","last_became_active":"2024-04-25T12:50:13.364260+0000","last_became_peered":"2024-04-25T12:50:13.364260+0000","last_unstale":"2024-04-25T12:51:04.297900+0000","last_undegraded":"2024-04-25T12:51:04.297900+0000","last_fullsized":"2024-04-25T12:51:04.297900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:04.297771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:04.297771+0000","last_clean_scrub_stamp":"2024-04-25T12:51:04.297771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T19:10:06.227516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:15.531980+0000","last_change":"2024-04-25T12:51:15.532005+0000","last_active":"2024-04-25T12:51:15.531980+0000","last_peered":"2024-04-25T12:51:15.531980+0000","last_clean":"2024-04-25T12:51:15.531980+0000","last_became_active":"2024-04-25T12:50:13.366600+0000","last_became_peered":"2024-04-25T12:50:13.366600+0000","last_unstale":"2024-04-25T12:51:15.531980+0000","last_undegraded":"2024-04-25T12:51:15.531980+0000","last_fullsized":"2024-04-25T12:51:15.531980+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:15.531883+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:15.531883+0000","last_clean_scrub_stamp":"2024-04-25T12:51:15.531883+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:18:14.419864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.556625+0000","last_change":"2024-04-25T12:51:11.556651+0000","last_active":"2024-04-25T12:51:11.556625+0000","last_peered":"2024-04-25T12:51:11.556625+0000","last_clean":"2024-04-25T12:51:11.556625+0000","last_became_active":"2024-04-25T12:50:13.360177+0000","last_became_peered":"2024-04-25T12:50:13.360177+0000","last_unstale":"2024-04-25T12:51:11.556625+0000","last_undegraded":"2024-04-25T12:51:11.556625+0000","last_fullsized":"2024-04-25T12:51:11.556625+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.556523+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.556523+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.556523+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:36:17.132240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:03.497684+0000","last_change":"2024-04-25T12:51:03.497710+0000","last_active":"2024-04-25T12:51:03.497684+0000","last_peered":"2024-04-25T12:51:03.497684+0000","last_clean":"2024-04-25T12:51:03.497684+0000","last_became_active":"2024-04-25T12:50:13.365026+0000","last_became_peered":"2024-04-25T12:50:13.365026+0000","last_unstale":"2024-04-25T12:51:03.497684+0000","last_undegraded":"2024-04-25T12:51:03.497684+0000","last_fullsized":"2024-04-25T12:51:03.497684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:03.497599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:03.497599+0000","last_clean_scrub_stamp":"2024-04-25T12:51:03.497599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T23:37:52.648912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:08.515700+0000","last_change":"2024-04-25T12:51:08.515727+0000","last_active":"2024-04-25T12:51:08.515700+0000","last_peered":"2024-04-25T12:51:08.515700+0000","last_clean":"2024-04-25T12:51:08.515700+0000","last_became_active":"2024-04-25T12:50:13.360618+0000","last_became_peered":"2024-04-25T12:50:13.360618+0000","last_unstale":"2024-04-25T12:51:08.515700+0000","last_undegraded":"2024-04-25T12:51:08.515700+0000","last_fullsized":"2024-04-25T12:51:08.515700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:08.515599+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:08.515599+0000","last_clean_scrub_stamp":"2024-04-25T12:51:08.515599+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T21:56:28.906494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:07.732835+0000","last_change":"2024-04-25T12:51:07.732861+0000","last_active":"2024-04-25T12:51:07.732835+0000","last_peered":"2024-04-25T12:51:07.732835+0000","last_clean":"2024-04-25T12:51:07.732835+0000","last_became_active":"2024-04-25T12:50:13.359111+0000","last_became_peered":"2024-04-25T12:50:13.359111+0000","last_unstale":"2024-04-25T12:51:07.732835+0000","last_undegraded":"2024-04-25T12:51:07.732835+0000","last_fullsized":"2024-04-25T12:51:07.732835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:07.732726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:07.732726+0000","last_clean_scrub_stamp":"2024-04-25T12:51:07.732726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:28:25.771129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.756861+0000","last_change":"2024-04-25T12:51:11.756895+0000","last_active":"2024-04-25T12:51:11.756861+0000","last_peered":"2024-04-25T12:51:11.756861+0000","last_clean":"2024-04-25T12:51:11.756861+0000","last_became_active":"2024-04-25T12:50:13.361504+0000","last_became_peered":"2024-04-25T12:50:13.361504+0000","last_unstale":"2024-04-25T12:51:11.756861+0000","last_undegraded":"2024-04-25T12:51:11.756861+0000","last_fullsized":"2024-04-25T12:51:11.756861+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.756787+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.756787+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.756787+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T15:46:50.207174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-04-25T12:51:11.480182+0000","last_change":"2024-04-25T12:51:11.480226+0000","last_active":"2024-04-25T12:51:11.480182+0000","last_peered":"2024-04-25T12:51:11.480182+0000","last_clean":"2024-04-25T12:51:11.480182+0000","last_became_active":"2024-04-25T12:50:13.361938+0000","last_became_peered":"2024-04-25T12:50:13.361938+0000","last_unstale":"2024-04-25T12:51:11.480182+0000","last_undegraded":"2024-04-25T12:51:11.480182+0000","last_fullsized":"2024-04-25T12:51:11.480182+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T12:51:11.480083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T12:51:11.480083+0000","last_clean_scrub_stamp":"2024-04-25T12:51:11.480083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T18:53:34.588932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5037,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":51,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":10074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":65,"ondisk_log_size":65,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":14,"seq":60129542167,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":118719,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":14,"seq":60129542168,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27888,"kb_used_data":872,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343952,"statfs":{"total":96636764160,"available":96608206848,"internally_reserved":0,"allocated":892928,"data_stored":709565,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32040,"kb_used_data":864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339800,"statfs":{"total":96636764160,"available":96603955200,"internally_reserved":0,"allocated":884736,"data_stored":709509,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":122798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31460,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340380,"statfs":{"total":96636764160,"available":96604549120,"internally_reserved":0,"allocated":290816,"data_stored":118649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31468,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340372,"statfs":{"total":96636764160,"available":96604540928,"internally_reserved":0,"allocated":299008,"data_stored":118685,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":48,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27308,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344532,"statfs":{"total":96636764160,"available":96608800768,"internally_reserved":0,"allocated":299008,"data_stored":122798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":286720,"data_stored":118559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":4239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T12:51:43.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T12:51:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 Processor -- start 2024-04-25T12:51:43.898 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 -- start start 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e0415c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e04072ea0 0x7f2e04073310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e041538d0 con 0x7f2e040cbcb0 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f2e04159130 con 0x7f2e04072ea0 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.900+0000 7f2e094f5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e040c6670 con 0x7f2e041534f0 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e037fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e04072ea0 0x7f2e04073310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.900 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2dfa7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2e040cbcb0 0x7f2e040c5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34180/0 (socket says 172.21.15.132:34180) 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2dfa7fc640 1 -- 172.21.15.132:0/1163987581 learned_addr learned my addr 172.21.15.132:0/1163987581 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e02ffd640 1 --2- 172.21.15.132:0/1163987581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e0415c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e037fe640 1 -- 172.21.15.132:0/1163987581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 msgr2=0x7f2e0415c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e037fe640 1 --2- 172.21.15.132:0/1163987581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e0415c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e037fe640 1 -- 172.21.15.132:0/1163987581 >> v1:172.21.15.132:6789/0 conn(0x7f2e040cbcb0 legacy=0x7f2e040c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e027fc640 1 -- 172.21.15.132:0/1163987581 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2394941297 0 0) 0x7f2e041538d0 con 0x7f2e040cbcb0 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.901+0000 7f2e037fe640 1 -- 172.21.15.132:0/1163987581 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e040c6950 con 0x7f2e04072ea0 2024-04-25T12:51:43.901 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e037fe640 1 --2- 172.21.15.132:0/1163987581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04073310 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009d90 tx=0x7f2dfc02a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f7565ae8af9080b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e027fc640 1 -- 172.21.15.132:0/1163987581 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc007740 con 0x7f2e04072ea0 2024-04-25T12:51:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e027fc640 1 -- 172.21.15.132:0/1163987581 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2dfc0078e0 con 0x7f2e04072ea0 2024-04-25T12:51:43.902 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e027fc640 1 -- 172.21.15.132:0/1163987581 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dfc007cb0 con 0x7f2e04072ea0 2024-04-25T12:51:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 -- 172.21.15.132:0/1163987581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 msgr2=0x7f2e04073310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1163987581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04073310 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f2dfc009d90 tx=0x7f2dfc02a660 comp rx=0 tx=0).stop 2024-04-25T12:51:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 -- 172.21.15.132:0/1163987581 shutdown_connections 2024-04-25T12:51:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1163987581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04073310 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.905 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1163987581 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e0415c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 -- 172.21.15.132:0/1163987581 >> 172.21.15.132:0/1163987581 conn(0x7f2e04070a90 msgr2=0x7f2e04070ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 -- 172.21.15.132:0/1163987581 shutdown_connections 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.902+0000 7f2e094f5640 1 -- 172.21.15.132:0/1163987581 wait complete. 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.903+0000 7f2e094f5640 1 Processor -- start 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 -- start start 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e040cbcb0 0x7f2e04155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.906 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e040c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f2e0415cbe0 con 0x7f2e04072ea0 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f2e041596d0 con 0x7f2e040cbcb0 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e094f5640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f2e040c8cb0 con 0x7f2e041534f0 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04153a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59114/0 (socket says 172.21.15.132:59114) 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.904+0000 7f2e02ffd640 1 -- 172.21.15.132:0/1323857352 learned_addr learned my addr 172.21.15.132:0/1323857352 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e02ffd640 1 -- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 msgr2=0x7f2e040c97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e02ffd640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e040c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.907 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e02ffd640 1 -- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e040cbcb0 msgr2=0x7f2e04155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2dfa7fc640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e040cbcb0 0x7f2e04155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e02ffd640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e040cbcb0 0x7f2e04155f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e02ffd640 1 -- 172.21.15.132:0/1323857352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e04153f90 con 0x7f2e04072ea0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e02ffd640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04153a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2df400e8a0 tx=0x7f2df400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df4017070 con 0x7f2e04072ea0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2df400c940 con 0x7f2e04072ea0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e04156ac0 con 0x7f2e04072ea0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2df400cd30 con 0x7f2e04072ea0 2024-04-25T12:51:43.908 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.905+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e0414fd50 con 0x7f2e04072ea0 2024-04-25T12:51:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.906+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e040c78e0 con 0x7f2e04072ea0 2024-04-25T12:51:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.906+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2df401a070 con 0x7f2e04072ea0 2024-04-25T12:51:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.907+0000 7f2dfbfff640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2de406c8f0 0x7f2de406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.907+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f2df408bf10 con 0x7f2e04072ea0 2024-04-25T12:51:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.907+0000 7f2dfa7fc640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2de406c8f0 0x7f2de406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:43.909 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.907+0000 7f2dfa7fc640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2de406c8f0 0x7f2de406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e04154ef0 tx=0x7f2dec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:43.910 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:43.911+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2e040c78e0 con 0x7f2e04072ea0 2024-04-25T12:51:44.086 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.088+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f2e04068d00 con 0x7f2e04072ea0 2024-04-25T12:51:44.089 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.091+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f2df4059e90 con 0x7f2e04072ea0 2024-04-25T12:51:44.091 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.093+0000 7f2dfbfff640 1 -- 172.21.15.132:0/1323857352 <== mon.0 v2:172.21.15.132:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2df4059790 con 0x7f2e04072ea0 2024-04-25T12:51:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2de406c8f0 msgr2=0x7f2de406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2de406c8f0 0x7f2de406edb0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2e04154ef0 tx=0x7f2dec009040 comp rx=0 tx=0).stop 2024-04-25T12:51:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 msgr2=0x7f2e04153a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04153a50 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f2df400e8a0 tx=0x7f2df400ed60 comp rx=0 tx=0).stop 2024-04-25T12:51:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 shutdown_connections 2024-04-25T12:51:44.093 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f2de406c8f0 0x7f2de406edb0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f2e041534f0 0x7f2e040c97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f2e040cbcb0 0x7f2e04155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 --2- 172.21.15.132:0/1323857352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e04072ea0 0x7f2e04153a50 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.094+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 >> 172.21.15.132:0/1323857352 conn(0x7f2e04070a90 msgr2=0x7f2e041525d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.095+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 shutdown_connections 2024-04-25T12:51:44.094 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.095+0000 7f2e094f5640 1 -- 172.21.15.132:0/1323857352 wait complete. 2024-04-25T12:51:44.103 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T12:51:44.104 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:51:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.202+0000 7f62497fe640 1 Processor -- start 2024-04-25T12:51:44.200 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.202+0000 7f62497fe640 1 -- start start 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62497fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f62440cc140 0x7f624406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62497fe640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624415ed80 con 0x7f62440cc730 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62497fe640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624415f060 con 0x7f62441557e0 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62497fe640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f62440cb5a0 con 0x7f62440cc140 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62437fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f62440cc730 0x7f624406cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34184/0 (socket says 172.21.15.132:34184) 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62437fe640 1 -- 172.21.15.132:0/2578922806 learned_addr learned my addr 172.21.15.132:0/2578922806 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:44.204 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f62427fc640 1 --2- 172.21.15.132:0/2578922806 >> v2:172.21.15.157:3300/0 conn(0x7f62440cc140 0x7f624406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1792626026 0 0) 0x7f624415ed80 con 0x7f62440cc730 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f622c003520 con 0x7f62440cc730 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3000600459 0 0) 0x7f622c003520 con 0x7f62440cc730 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 >> v2:172.21.15.157:3300/0 conn(0x7f62440cc140 msgr2=0x7f624406c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 --2- 172.21.15.132:0/2578922806 >> v2:172.21.15.157:3300/0 conn(0x7f62440cc140 0x7f624406c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 >> v1:172.21.15.157:6789/0 conn(0x7f62441557e0 legacy=0x7f62440cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.205 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624415f340 con 0x7f62440cc730 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f623c001670 con 0x7f62440cc730 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 >> v1:172.21.15.132:6789/0 conn(0x7f62440cc730 legacy=0x7f624406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f622c0039b0 0x7f622c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c004800 0x7f622c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f622c0051c0 0x7f622c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f62440cb5a0 con 0x7f622c0039b0 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f622c00c060 con 0x7f622c0051c0 2024-04-25T12:51:44.206 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f622c00c260 con 0x7f622c004800 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.203+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f622c0039b0 0x7f622c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f62437fe640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f622c0051c0 0x7f622c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f62427fc640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c004800 0x7f622c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f6242ffd640 1 -- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c004800 msgr2=0x7f622c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c004800 0x7f622c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f6242ffd640 1 -- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f622c0051c0 msgr2=0x7f622c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f622c0051c0 0x7f622c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.207 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f6242ffd640 1 -- 172.21.15.132:0/2578922806 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f622c003520 con 0x7f622c0039b0 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f62437fe640 1 -- 172.21.15.132:0/2578922806 reap_dead start 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.204+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f622c0039b0 0x7f622c003dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6234001e50 tx=0x7f622c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f8f63b6bf7a3c65 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234001a70 con 0x7f622c0039b0 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f623402ae40 con 0x7f622c0039b0 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f6241ffb640 1 -- 172.21.15.132:0/2578922806 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6234003bd0 con 0x7f622c0039b0 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 -- 172.21.15.132:0/2578922806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f622c0039b0 msgr2=0x7f622c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f622c0039b0 0x7f622c003dd0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f6234001e50 tx=0x7f622c005830 comp rx=0 tx=0).stop 2024-04-25T12:51:44.208 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 -- 172.21.15.132:0/2578922806 shutdown_connections 2024-04-25T12:51:44.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 --2- 172.21.15.132:0/2578922806 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f622c0039b0 0x7f622c003dd0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 -- 172.21.15.132:0/2578922806 >> 172.21.15.132:0/2578922806 conn(0x7f62440d0e10 msgr2=0x7f62440d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:44.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 -- 172.21.15.132:0/2578922806 shutdown_connections 2024-04-25T12:51:44.209 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.205+0000 7f62497fe640 1 -- 172.21.15.132:0/2578922806 wait complete. 2024-04-25T12:51:44.211 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.206+0000 7f62497fe640 1 Processor -- start 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.206+0000 7f62497fe640 1 -- start start 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62497fe640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c0039b0 0x7f62440c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62497fe640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624415c510 0x7f62441452b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62497fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 0x7f62441457f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62497fe640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f62440cd240 con 0x7f624415ca40 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62497fe640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f62440cd0c0 con 0x7f624415c510 2024-04-25T12:51:44.212 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62497fe640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f624415e920 con 0x7f622c0039b0 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 0x7f62441457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 0x7f62441457f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59140/0 (socket says 172.21.15.132:59140) 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62437fe640 1 -- 172.21.15.132:0/2502408276 learned_addr learned my addr 172.21.15.132:0/2502408276 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f62427fc640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624415c510 0x7f62441452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.207+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c0039b0 0x7f62440c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62437fe640 1 -- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c0039b0 msgr2=0x7f62440c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62437fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c0039b0 0x7f62440c6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62437fe640 1 -- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624415c510 msgr2=0x7f62441452b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.213 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62437fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624415c510 0x7f62441452b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62437fe640 1 -- 172.21.15.132:0/2502408276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6244154350 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62437fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 0x7f62441457f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f624406dab0 tx=0x7f623c007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c01a070 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f623c00f620 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6244154760 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f623c00fa10 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.208+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f624414bf20 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.209+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6244068c20 con 0x7f624415ca40 2024-04-25T12:51:44.214 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.209+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f623c01d070 con 0x7f624415ca40 2024-04-25T12:51:44.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.210+0000 7f622b7fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f623006c8f0 0x7f623006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.210+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f623006c8f0 0x7f623006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.210+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f623c08b350 con 0x7f624415ca40 2024-04-25T12:51:44.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.210+0000 7f6242ffd640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f623006c8f0 0x7f623006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6234032000 tx=0x7f623402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.215 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.214+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f623c058c80 con 0x7f624415ca40 2024-04-25T12:51:44.421 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.423+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62440ca110 con 0x7f624415ca40 2024-04-25T12:51:44.422 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.424+0000 7f622b7fe640 1 -- 172.21.15.132:0/2502408276 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6841 (secure 0 0 0) 0x7f623c05cf80 con 0x7f624415ca40 2024-04-25T12:51:44.423 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:51:44.423 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:40.764315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:51:44.423 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2024-04-25T12:51:44.424 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f623006c8f0 msgr2=0x7f623006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f623006c8f0 0x7f623006edb0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6234032000 tx=0x7f623402e000 comp rx=0 tx=0).stop 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 msgr2=0x7f62441457f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 0x7f62441457f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f624406dab0 tx=0x7f623c007430 comp rx=0 tx=0).stop 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 shutdown_connections 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f623006c8f0 0x7f623006edb0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624415ca40 0x7f62441457f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.425 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f624415c510 0x7f62441452b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 --2- 172.21.15.132:0/2502408276 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f622c0039b0 0x7f62440c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 >> 172.21.15.132:0/2502408276 conn(0x7f62440d0e10 msgr2=0x7f62440cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 shutdown_connections 2024-04-25T12:51:44.426 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.426+0000 7f62497fe640 1 -- 172.21.15.132:0/2502408276 wait complete. 2024-04-25T12:51:44.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T12:51:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.534+0000 7f7ac9420640 1 Processor -- start 2024-04-25T12:51:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.534+0000 7f7ac9420640 1 -- start start 2024-04-25T12:51:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.534+0000 7f7ac9420640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f7ac40cc140 0x7f7ac406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.534+0000 7f7ac9420640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac415ed80 con 0x7f7ac41557e0 2024-04-25T12:51:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.534+0000 7f7ac9420640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac415f060 con 0x7f7ac40cc730 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.534+0000 7f7ac9420640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f7ac40cb5a0 con 0x7f7ac40cc140 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac2ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7ac41557e0 0x7f7ac40cba30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34200/0 (socket says 172.21.15.132:34200) 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac2ffd640 1 -- 172.21.15.132:0/4222060337 learned_addr learned my addr 172.21.15.132:0/4222060337 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac27fc640 1 --2- 172.21.15.132:0/4222060337 >> v2:172.21.15.157:3300/0 conn(0x7f7ac40cc140 0x7f7ac406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac1ffb640 1 -- 172.21.15.132:0/4222060337 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438073770 0 0) 0x7f7ac415ed80 con 0x7f7ac41557e0 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac1ffb640 1 -- 172.21.15.132:0/4222060337 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab0003520 con 0x7f7ac41557e0 2024-04-25T12:51:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac27fc640 1 -- 172.21.15.132:0/4222060337 >> v1:172.21.15.157:6789/0 conn(0x7f7ac40cc730 legacy=0x7f7ac406cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac27fc640 1 -- 172.21.15.132:0/4222060337 >> v1:172.21.15.132:6789/0 conn(0x7f7ac41557e0 legacy=0x7f7ac40cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.535+0000 7f7ac27fc640 1 -- 172.21.15.132:0/4222060337 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac415f340 con 0x7f7ac40cc140 2024-04-25T12:51:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac27fc640 1 --2- 172.21.15.132:0/4222060337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc140 0x7f7ac406c9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0097a0 tx=0x7f7aac02a230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ae8661bd36e45c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac1ffb640 1 -- 172.21.15.132:0/4222060337 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac037070 con 0x7f7ac40cc140 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac1ffb640 1 -- 172.21.15.132:0/4222060337 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7aac032440 con 0x7f7ac40cc140 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac1ffb640 1 -- 172.21.15.132:0/4222060337 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aac0327f0 con 0x7f7ac40cc140 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac9420640 1 -- 172.21.15.132:0/4222060337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc140 msgr2=0x7f7ac406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac9420640 1 --2- 172.21.15.132:0/4222060337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc140 0x7f7ac406c9c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f7aac0097a0 tx=0x7f7aac02a230 comp rx=0 tx=0).stop 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac9420640 1 -- 172.21.15.132:0/4222060337 shutdown_connections 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.536+0000 7f7ac9420640 1 --2- 172.21.15.132:0/4222060337 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc140 0x7f7ac406c9c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.541 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.537+0000 7f7ac9420640 1 -- 172.21.15.132:0/4222060337 >> 172.21.15.132:0/4222060337 conn(0x7f7ac40d0e10 msgr2=0x7f7ac40d1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.537+0000 7f7ac9420640 1 -- 172.21.15.132:0/4222060337 shutdown_connections 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.537+0000 7f7ac9420640 1 -- 172.21.15.132:0/4222060337 wait complete. 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.538+0000 7f7ac9420640 1 Processor -- start 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.538+0000 7f7ac9420640 1 -- start start 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.538+0000 7f7ac9420640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ac40cc140 0x7f7ac41e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.538+0000 7f7ac9420640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc730 0x7f7ac41e7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.538+0000 7f7ac9420640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 0x7f7ac40cede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.542 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.538+0000 7f7ac9420640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac40cd0c0 con 0x7f7ac41557e0 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac9420640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac406d610 con 0x7f7ac40cc730 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac9420640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f7ac40cd240 con 0x7f7ac40cc140 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 0x7f7ac40cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 0x7f7ac40cede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59148/0 (socket says 172.21.15.132:59148) 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 -- 172.21.15.132:0/873395333 learned_addr learned my addr 172.21.15.132:0/873395333 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac2ffd640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ac40cc140 0x7f7ac41e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac27fc640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc730 0x7f7ac41e7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.543 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 -- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ac40cc140 msgr2=0x7f7ac41e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ac40cc140 0x7f7ac41e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 -- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc730 msgr2=0x7f7ac41e7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc730 0x7f7ac41e7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 -- 172.21.15.132:0/873395333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac41f4e50 con 0x7f7ac41557e0 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac37fe640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 0x7f7ac40cede0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00c7d0 tx=0x7f7abc00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc003b70 con 0x7f7ac41557e0 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f7abc003d30 con 0x7f7ac41557e0 2024-04-25T12:51:44.544 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac40cfd50 con 0x7f7ac41557e0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7abc00aab0 con 0x7f7ac41557e0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.539+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac40d0520 con 0x7f7ac41557e0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.540+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac4068c20 con 0x7f7ac41557e0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.541+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7abc00ac50 con 0x7f7ac41557e0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.541+0000 7f7abb7fe640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7aa406c920 0x7f7aa406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.541+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f7abc08bdd0 con 0x7f7ac41557e0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.541+0000 7f7ac2ffd640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7aa406c920 0x7f7aa406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.545 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.542+0000 7f7ac2ffd640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7aa406c920 0x7f7aa406ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40011e0 tx=0x7f7ab4007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.546+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7abc059710 con 0x7f7ac41557e0 2024-04-25T12:51:44.756 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.758+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ac40c7f70 con 0x7f7ac41557e0 2024-04-25T12:51:44.757 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.759+0000 7f7abb7fe640 1 -- 172.21.15.132:0/873395333 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+6841 (secure 0 0 0) 0x7f7abc05da10 con 0x7f7ac41557e0 2024-04-25T12:51:44.757 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:51:44.757 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":9,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6838/2929407697","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2929407697},{"type":"v1","addr":"172.21.15.132:6838","nonce":2929407697}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4269,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3403957994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3403957994},{"type":"v1","addr":"172.21.15.132:6837","nonce":3403957994}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4275,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6839/4178209469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":4178209469},{"type":"v1","addr":"172.21.15.132:6839","nonce":4178209469}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6833/564204848","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6832","nonce":564204848},{"type":"v1","addr":"172.21.15.157:6833","nonce":564204848}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4293,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.157:6835/2549333952","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6834","nonce":2549333952},{"type":"v1","addr":"172.21.15.157:6835","nonce":2549333952}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":9,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T12:50:12.686402+0000","modified":"2024-04-25T12:50:40.764315+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4296},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4296":{"gid":4296,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.157:6837/2805783268","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6836","nonce":2805783268},{"type":"v1","addr":"172.21.15.157:6837","nonce":2805783268}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4296,"qdb_cluster":[4296]},"id":1}]} 2024-04-25T12:51:44.758 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 9 2024-04-25T12:51:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7aa406c920 msgr2=0x7f7aa406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7aa406c920 0x7f7aa406ede0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7ab40011e0 tx=0x7f7ab4007d30 comp rx=0 tx=0).stop 2024-04-25T12:51:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 msgr2=0x7f7ac40cede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.759 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 0x7f7ac40cede0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f7abc00c7d0 tx=0x7f7abc00cc90 comp rx=0 tx=0).stop 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 shutdown_connections 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f7aa406c920 0x7f7aa406ede0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ac41557e0 0x7f7ac40cede0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f7ac40cc730 0x7f7ac41e7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 --2- 172.21.15.132:0/873395333 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f7ac40cc140 0x7f7ac41e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 >> 172.21.15.132:0/873395333 conn(0x7f7ac40d0e10 msgr2=0x7f7ac40c6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:44.760 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 shutdown_connections 2024-04-25T12:51:44.761 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.761+0000 7f7ac9420640 1 -- 172.21.15.132:0/873395333 wait complete. 2024-04-25T12:51:44.770 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T12:51:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.868+0000 7f78c2059640 1 Processor -- start 2024-04-25T12:51:44.866 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.868+0000 7f78c2059640 1 -- start start 2024-04-25T12:51:44.870 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78c2059640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f78bc0cbd90 0x7f78bc15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78c2059640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78bc15a580 con 0x7f78bc0c5870 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78c2059640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78bc159640 con 0x7f78bc15d330 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78c2059640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f78bc15c680 con 0x7f78bc0cbd90 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78baffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f78bc0c5870 0x7f78bc0c81e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34202/0 (socket says 172.21.15.132:34202) 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78baffd640 1 -- 172.21.15.132:0/2449355836 learned_addr learned my addr 172.21.15.132:0/2449355836 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/2449355836 >> v2:172.21.15.157:3300/0 conn(0x7f78bc0cbd90 0x7f78bc15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.871 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1836578285 0 0) 0x7f78bc15a580 con 0x7f78bc0c5870 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a4003520 con 0x7f78bc0c5870 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.1 v1:172.21.15.157:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3402100121 0 0) 0x7f78bc159640 con 0x7f78bc15d330 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 --> v1:172.21.15.157:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78bc15a580 con 0x7f78bc15d330 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3932719207 0 0) 0x7f78a4003520 con 0x7f78bc0c5870 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 >> v2:172.21.15.157:3300/0 conn(0x7f78bc0cbd90 msgr2=0x7f78bc15cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/2449355836 >> v2:172.21.15.157:3300/0 conn(0x7f78bc0cbd90 0x7f78bc15cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 >> v1:172.21.15.157:6789/0 conn(0x7f78bc15d330 legacy=0x7f78bc163a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc159920 con 0x7f78bc0c5870 2024-04-25T12:51:44.872 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1657799374 0 0) 0x7f78b0001670 con 0x7f78bc0c5870 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.869+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 >> v1:172.21.15.132:6789/0 conn(0x7f78bc0c5870 legacy=0x7f78bc0c81e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78a4003b40 0x7f78a4003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4004800 0x7f78a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a40051c0 0x7f78a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc15c680 con 0x7f78a40051c0 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f78a400bfb0 con 0x7f78a4003b40 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f78a400c1b0 con 0x7f78a4004800 2024-04-25T12:51:44.873 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bbfff640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a40051c0 0x7f78a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78a4003b40 0x7f78a4003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78baffd640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4004800 0x7f78a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bbfff640 1 -- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4004800 msgr2=0x7f78a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bbfff640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a4004800 0x7f78a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bbfff640 1 -- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78a4003b40 msgr2=0x7f78a4003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bbfff640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78a4003b40 0x7f78a4003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.870+0000 7f78bbfff640 1 -- 172.21.15.132:0/2449355836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a4003520 con 0x7f78a40051c0 2024-04-25T12:51:44.874 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78bbfff640 1 -- 172.21.15.132:0/2449355836 reap_dead start 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78bbfff640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a40051c0 0x7f78a400b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f78bc15d7a0 tx=0x7f78a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14f64ec21980613b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4001bf0 con 0x7f78a40051c0 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f78b4003b70 con 0x7f78a40051c0 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78ba7fc640 1 -- 172.21.15.132:0/2449355836 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b40050d0 con 0x7f78a40051c0 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 -- 172.21.15.132:0/2449355836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a40051c0 msgr2=0x7f78a400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a40051c0 0x7f78a400b9c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f78bc15d7a0 tx=0x7f78a4005830 comp rx=0 tx=0).stop 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 -- 172.21.15.132:0/2449355836 shutdown_connections 2024-04-25T12:51:44.875 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 --2- 172.21.15.132:0/2449355836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78a40051c0 0x7f78a400b9c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 -- 172.21.15.132:0/2449355836 >> 172.21.15.132:0/2449355836 conn(0x7f78bc072f10 msgr2=0x7f78bc073320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 -- 172.21.15.132:0/2449355836 shutdown_connections 2024-04-25T12:51:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.871+0000 7f78c2059640 1 -- 172.21.15.132:0/2449355836 wait complete. 2024-04-25T12:51:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 Processor -- start 2024-04-25T12:51:44.876 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 -- start start 2024-04-25T12:51:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a40051c0 0x7f78bc1e2f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78bc1e4aa0 0x7f78bc1ef9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 0x7f78bc1f24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc15c8d0 con 0x7f78bc0cea90 2024-04-25T12:51:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f78bc159ee0 con 0x7f78bc1e4aa0 2024-04-25T12:51:44.879 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78c2059640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f78bc0cc170 con 0x7f78a40051c0 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 0x7f78bc1f24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78bbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 0x7f78bc1f24e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59160/0 (socket says 172.21.15.132:59160) 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.873+0000 7f78bbfff640 1 -- 172.21.15.132:0/637770721 learned_addr learned my addr 172.21.15.132:0/637770721 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78baffd640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78bc1e4aa0 0x7f78bc1ef9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a40051c0 0x7f78bc1e2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bbfff640 1 -- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a40051c0 msgr2=0x7f78bc1e2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bbfff640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a40051c0 0x7f78bc1e2f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bbfff640 1 -- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78bc1e4aa0 msgr2=0x7f78bc1ef9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:44.880 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bbfff640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78bc1e4aa0 0x7f78bc1ef9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bbfff640 1 -- 172.21.15.132:0/637770721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78bc1eff00 con 0x7f78bc0cea90 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a40051c0 0x7f78bc1e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78bbfff640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 0x7f78bc1f24e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f78b4002090 tx=0x7f78b4001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4042070 con 0x7f78bc0cea90 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f78b4006b50 con 0x7f78bc0cea90 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78bc1e24f0 con 0x7f78bc0cea90 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78b4007030 con 0x7f78bc0cea90 2024-04-25T12:51:44.881 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.874+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78bc156920 con 0x7f78bc0cea90 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.875+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78bc0c70e0 con 0x7f78bc0cea90 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.876+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f78b4045070 con 0x7f78bc0cea90 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.876+0000 7f78a3fff640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78a806c8f0 0x7f78a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.876+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7f78b40abdb0 con 0x7f78bc0cea90 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.876+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78a806c8f0 0x7f78a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.876+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78a806c8f0 0x7f78a806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009b40 tx=0x7f78ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:44.882 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:44.880+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f78bc0c70e0 con 0x7f78bc0cea90 2024-04-25T12:51:45.056 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.058+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78bc068c20 con 0x7f78bc0cea90 2024-04-25T12:51:45.057 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.059+0000 7f78a3fff640 1 -- 172.21.15.132:0/637770721 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18985 (secure 0 0 0) 0x7f78b4079d30 con 0x7f78bc0cea90 2024-04-25T12:51:45.057 INFO:teuthology.orchestra.run.smithi132.stdout: 2024-04-25T12:51:45.057 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":27,"fsid":"5bda364d-1418-47e5-9931-4f49e5bffd9b","created":"2024-04-25T12:49:49.043073+0000","modified":"2024-04-25T12:50:54.470996+0000","last_up_change":"2024-04-25T12:50:00.287968+0000","last_in_change":"2024-04-25T12:49:51.196320+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T12:50:01.141124+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-25T12:50:11.154024+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-25T12:50:11.639000+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-25T12:50:15.365379+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"20381eac-0560-48e6-8045-d8dfbb7a5b37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6809","nonce":3942408497}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6811","nonce":3942408497}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6815","nonce":3942408497}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":3942408497},{"type":"v1","addr":"172.21.15.132:6813","nonce":3942408497}]},"public_addr":"172.21.15.132:6809/3942408497","cluster_addr":"172.21.15.132:6811/3942408497","heartbeat_back_addr":"172.21.15.132:6815/3942408497","heartbeat_front_addr":"172.21.15.132:6813/3942408497","state":["exists","up"]},{"osd":1,"uuid":"f746ae1e-b1e1-4f4c-9d19-b1436ab19a08","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6801","nonce":2744549492}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6803","nonce":2744549492}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6807","nonce":2744549492}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":2744549492},{"type":"v1","addr":"172.21.15.132:6805","nonce":2744549492}]},"public_addr":"172.21.15.132:6801/2744549492","cluster_addr":"172.21.15.132:6803/2744549492","heartbeat_back_addr":"172.21.15.132:6807/2744549492","heartbeat_front_addr":"172.21.15.132:6805/2744549492","state":["exists","up"]},{"osd":2,"uuid":"37ad6072-e688-4038-9fd1-c375856716d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6817","nonce":1070089983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6819","nonce":1070089983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6823","nonce":1070089983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":1070089983},{"type":"v1","addr":"172.21.15.132:6821","nonce":1070089983}]},"public_addr":"172.21.15.132:6817/1070089983","cluster_addr":"172.21.15.132:6819/1070089983","heartbeat_back_addr":"172.21.15.132:6823/1070089983","heartbeat_front_addr":"172.21.15.132:6821/1070089983","state":["exists","up"]},{"osd":3,"uuid":"7a35c236-6773-4df2-8b6d-7edf1d3181ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6824","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6825","nonce":4017369703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6827","nonce":4017369703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6831","nonce":4017369703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":4017369703},{"type":"v1","addr":"172.21.15.132:6829","nonce":4017369703}]},"public_addr":"172.21.15.132:6825/4017369703","cluster_addr":"172.21.15.132:6827/4017369703","heartbeat_back_addr":"172.21.15.132:6831/4017369703","heartbeat_front_addr":"172.21.15.132:6829/4017369703","state":["exists","up"]},{"osd":4,"uuid":"62b0a01e-475b-43c0-ba7e-4ce62fbc7a9b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6824","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6825","nonce":361858762}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6826","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6827","nonce":361858762}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6830","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6831","nonce":361858762}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6828","nonce":361858762},{"type":"v1","addr":"172.21.15.157:6829","nonce":361858762}]},"public_addr":"172.21.15.157:6825/361858762","cluster_addr":"172.21.15.157:6827/361858762","heartbeat_back_addr":"172.21.15.157:6831/361858762","heartbeat_front_addr":"172.21.15.157:6829/361858762","state":["exists","up"]},{"osd":5,"uuid":"d916d87f-d1a8-42d9-b7b8-f7b38ec7cc0f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6800","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6801","nonce":1305108505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6802","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6803","nonce":1305108505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6806","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6807","nonce":1305108505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6804","nonce":1305108505},{"type":"v1","addr":"172.21.15.157:6805","nonce":1305108505}]},"public_addr":"172.21.15.157:6801/1305108505","cluster_addr":"172.21.15.157:6803/1305108505","heartbeat_back_addr":"172.21.15.157:6807/1305108505","heartbeat_front_addr":"172.21.15.157:6805/1305108505","state":["exists","up"]},{"osd":6,"uuid":"a7ef4cde-4203-4769-a7c0-ffac4530418b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6816","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6817","nonce":898532685}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6818","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6819","nonce":898532685}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6822","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6823","nonce":898532685}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6820","nonce":898532685},{"type":"v1","addr":"172.21.15.157:6821","nonce":898532685}]},"public_addr":"172.21.15.157:6817/898532685","cluster_addr":"172.21.15.157:6819/898532685","heartbeat_back_addr":"172.21.15.157:6823/898532685","heartbeat_front_addr":"172.21.15.157:6821/898532685","state":["exists","up"]},{"osd":7,"uuid":"efff5515-7f38-428f-a888-d31e59c40d96","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6808","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6809","nonce":3050581758}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6810","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6811","nonce":3050581758}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6814","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6815","nonce":3050581758}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.157:6812","nonce":3050581758},{"type":"v1","addr":"172.21.15.157:6813","nonce":3050581758}]},"public_addr":"172.21.15.157:6809/3050581758","cluster_addr":"172.21.15.157:6811/3050581758","heartbeat_back_addr":"172.21.15.157:6815/3050581758","heartbeat_front_addr":"172.21.15.157:6813/3050581758","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.248130+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369680+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.323271+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.382065+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.340238+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.377704+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T12:49:56.369105+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.11","mappings":[{"from":7,"to":2}]},{"pgid":"3.1f","mappings":[{"from":5,"to":1}]},{"pgid":"3.22","mappings":[{"from":3,"to":1}]},{"pgid":"3.2a","mappings":[{"from":5,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T12:51:45.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78a806c8f0 msgr2=0x7f78a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78a806c8f0 0x7f78a806edb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f78ac009b40 tx=0x7f78ac008040 comp rx=0 tx=0).stop 2024-04-25T12:51:45.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 msgr2=0x7f78bc1f24e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 0x7f78bc1f24e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f78b4002090 tx=0x7f78b4001650 comp rx=0 tx=0).stop 2024-04-25T12:51:45.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 shutdown_connections 2024-04-25T12:51:45.060 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f78a806c8f0 0x7f78a806edb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0cea90 0x7f78bc1f24e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f78bc1e4aa0 0x7f78bc1ef9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 --2- 172.21.15.132:0/637770721 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f78a40051c0 0x7f78bc1e2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 >> 172.21.15.132:0/637770721 conn(0x7f78bc072f10 msgr2=0x7f78bc070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:45.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.061+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 shutdown_connections 2024-04-25T12:51:45.061 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.062+0000 7f78c2059640 1 -- 172.21.15.132:0/637770721 wait complete. 2024-04-25T12:51:45.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T12:51:45.170 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.172+0000 7faefbc23640 1 Processor -- start 2024-04-25T12:51:45.171 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.173+0000 7faefbc23640 1 -- start start 2024-04-25T12:51:45.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.173+0000 7faefbc23640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef40726e0 0x7faef415c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.173+0000 7faefbc23640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7faef40c82d0 0x7faef415cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.173+0000 7faefbc23640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faef415b310 con 0x7faef41444b0 2024-04-25T12:51:45.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.173+0000 7faefbc23640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7faef415c1e0 con 0x7faef40c82d0 2024-04-25T12:51:45.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.173+0000 7faefbc23640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faef415b5d0 con 0x7faef40726e0 2024-04-25T12:51:45.173 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faef99bf640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faef41444b0 0x7faef4067630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34210/0 (socket says 172.21.15.132:34210) 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faef99bf640 1 -- 172.21.15.132:0/2039826371 learned_addr learned my addr 172.21.15.132:0/2039826371 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faefa1c0640 1 --2- 172.21.15.132:0/2039826371 >> v2:172.21.15.157:3300/0 conn(0x7faef40c82d0 0x7faef415cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faef91be640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef40726e0 0x7faef415c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faef89bd640 1 -- 172.21.15.132:0/2039826371 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103600772 0 0) 0x7faef415b310 con 0x7faef41444b0 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faef89bd640 1 -- 172.21.15.132:0/2039826371 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faee0003520 con 0x7faef41444b0 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faefa1c0640 1 -- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef40726e0 msgr2=0x7faef415c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faefa1c0640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef40726e0 0x7faef415c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.174 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faefa1c0640 1 -- 172.21.15.132:0/2039826371 >> v1:172.21.15.132:6789/0 conn(0x7faef41444b0 legacy=0x7faef4067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faefa1c0640 1 -- 172.21.15.132:0/2039826371 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef415b8b0 con 0x7faef40c82d0 2024-04-25T12:51:45.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.174+0000 7faef91be640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef40726e0 0x7faef415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:51:45.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefa1c0640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40c82d0 0x7faef415cec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faeec009d90 tx=0x7faeec02a5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f57501bcd3ba058c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:45.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faef89bd640 1 -- 172.21.15.132:0/2039826371 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec031600 con 0x7faef40c82d0 2024-04-25T12:51:45.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faef89bd640 1 -- 172.21.15.132:0/2039826371 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faeec0317a0 con 0x7faef40c82d0 2024-04-25T12:51:45.175 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faef89bd640 1 -- 172.21.15.132:0/2039826371 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeec031b50 con 0x7faef40c82d0 2024-04-25T12:51:45.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefbc23640 1 -- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40c82d0 msgr2=0x7faef415cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefbc23640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40c82d0 0x7faef415cec0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faeec009d90 tx=0x7faeec02a5d0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefbc23640 1 -- 172.21.15.132:0/2039826371 shutdown_connections 2024-04-25T12:51:45.179 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefbc23640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40c82d0 0x7faef415cec0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefbc23640 1 --2- 172.21.15.132:0/2039826371 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef40726e0 0x7faef415c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.175+0000 7faefbc23640 1 -- 172.21.15.132:0/2039826371 >> 172.21.15.132:0/2039826371 conn(0x7faef406b930 msgr2=0x7faef406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.176+0000 7faefbc23640 1 -- 172.21.15.132:0/2039826371 shutdown_connections 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.176+0000 7faefbc23640 1 -- 172.21.15.132:0/2039826371 wait complete. 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 Processor -- start 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 -- start start 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40726e0 0x7faef40ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.180 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 0x7faef40cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef41444b0 0x7faef4142e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7faef4067d40 con 0x7faef40c82d0 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7faef415be70 con 0x7faef40726e0 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefbc23640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7faef4067ec0 con 0x7faef41444b0 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faef91be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 0x7faef40cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faef91be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 0x7faef40cb5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59174/0 (socket says 172.21.15.132:59174) 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faef91be640 1 -- 172.21.15.132:0/4229945448 learned_addr learned my addr 172.21.15.132:0/4229945448 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faef99bf640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40726e0 0x7faef40ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.181 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.177+0000 7faefa1c0640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef41444b0 0x7faef4142e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faef91be640 1 -- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef41444b0 msgr2=0x7faef4142e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faef91be640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef41444b0 0x7faef4142e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faef91be640 1 -- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40726e0 msgr2=0x7faef40ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faef91be640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40726e0 0x7faef40ccf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faef91be640 1 -- 172.21.15.132:0/4229945448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faef40cbb10 con 0x7faef40c82d0 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faef91be640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 0x7faef40cb5d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faef000e9e0 tx=0x7faef000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef0017070 con 0x7faef40c82d0 2024-04-25T12:51:45.182 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7faef000ca30 con 0x7faef40c82d0 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faef40cdfc0 con 0x7faef40c82d0 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef000ce40 con 0x7faef40c82d0 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.178+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faef40ce260 con 0x7faef40c82d0 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.179+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faef40741e0 con 0x7faef40c82d0 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.179+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faef001a070 con 0x7faef40c82d0 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.180+0000 7faeea7fc640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faed806c8f0 0x7faed806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.183 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.180+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6764+0+0 (secure 0 0 0) 0x7faef008be90 con 0x7faef40c82d0 2024-04-25T12:51:45.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.180+0000 7faef99bf640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faed806c8f0 0x7faed806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.180+0000 7faef99bf640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faed806c8f0 0x7faed806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faee4005880 tx=0x7faee4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:45.184 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.184+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faef0059850 con 0x7faef40c82d0 2024-04-25T12:51:45.393 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.395+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faef406fd50 con 0x7faef40c82d0 2024-04-25T12:51:45.395 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.397+0000 7faeea7fc640 1 -- 172.21.15.132:0/4229945448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v10) ==== 161+0+0 (secure 0 0 0) 0x7faef005db50 con 0x7faef40c82d0 2024-04-25T12:51:45.395 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T12:51:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.400+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faed806c8f0 msgr2=0x7faed806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.400+0000 7faefbc23640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faed806c8f0 0x7faed806edb0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7faee4005880 tx=0x7faee4009040 comp rx=0 tx=0).stop 2024-04-25T12:51:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.400+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 msgr2=0x7faef40cb5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.400+0000 7faefbc23640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 0x7faef40cb5d0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7faef000e9e0 tx=0x7faef000eea0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 shutdown_connections 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7faed806c8f0 0x7faed806edb0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7faef41444b0 0x7faef4142e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faef40c82d0 0x7faef40cb5d0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 --2- 172.21.15.132:0/4229945448 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7faef40726e0 0x7faef40ccf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 >> 172.21.15.132:0/4229945448 conn(0x7faef406b930 msgr2=0x7faef406bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 shutdown_connections 2024-04-25T12:51:45.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.401+0000 7faefbc23640 1 -- 172.21.15.132:0/4229945448 wait complete. 2024-04-25T12:51:45.404 INFO:tasks.ceph.mds.f.smithi157.stderr: -2959> 2024-04-25T12:50:27.750+0000 7f02f5e9f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T12:51:45.410 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T12:51:45.431 INFO:tasks.ceph.mds.f.smithi157.stdout:starting mds.f at 2024-04-25T12:51:45.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.511+0000 7f01c5751640 1 Processor -- start 2024-04-25T12:51:45.509 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.511+0000 7f01c5751640 1 -- start start 2024-04-25T12:51:45.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01c5751640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 0x7f01c01575d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01c5751640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01c00c95f0 0x7f01c00c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.511 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01c5751640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c0157c80 con 0x7f01c00c3a50 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01c5751640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7f01c0151da0 con 0x7f01c00c95f0 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01c5751640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f01c0158520 con 0x7f01c01519c0 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01beffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 0x7f01c01575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01bf7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01c00c95f0 0x7f01c00c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01beffd640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 0x7f01c01575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3301/0 says I am v2:172.21.15.132:57350/0 (socket says 172.21.15.132:57350) 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01bf7fe640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7f01c00c95f0 0x7f01c00c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:59016/0 (socket says 172.21.15.132:59016) 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01beffd640 1 -- 172.21.15.132:0/3123196828 learned_addr learned my addr 172.21.15.132:0/3123196828 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:45.512 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01be7fc640 1 --1- 172.21.15.132:0/3123196828 >> v1:172.21.15.157:6789/0 conn(0x7f01c00c3a50 0x7f01c00736b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:35838/0 (socket says 172.21.15.132:35838) 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01bf7fe640 1 -- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 msgr2=0x7f01c01575d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01bf7fe640 1 --2- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 0x7f01c01575d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01bf7fe640 1 -- 172.21.15.132:0/3123196828 >> v1:172.21.15.157:6789/0 conn(0x7f01c00c3a50 legacy=0x7f01c00736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01bf7fe640 1 -- 172.21.15.132:0/3123196828 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c0157f60 con 0x7f01c00c95f0 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.512+0000 7f01beffd640 1 --2- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 0x7f01c01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.513+0000 7f01bf7fe640 1 --2- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c00c7880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097a0 tx=0x7f01b802a180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc30a7760bc53c75 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.513+0000 7f01bdffb640 1 -- 172.21.15.132:0/3123196828 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8037070 con 0x7f01c00c95f0 2024-04-25T12:51:45.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.513+0000 7f01bdffb640 1 -- 172.21.15.132:0/3123196828 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f01b8032440 con 0x7f01c00c95f0 2024-04-25T12:51:45.514 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.513+0000 7f01bdffb640 1 -- 172.21.15.132:0/3123196828 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8032830 con 0x7f01c00c95f0 2024-04-25T12:51:45.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 -- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 msgr2=0x7f01c00c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 --2- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c00c7880 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f01b80097a0 tx=0x7f01b802a180 comp rx=0 tx=0).stop 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 -- 172.21.15.132:0/3123196828 shutdown_connections 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 --2- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c00c7880 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 --2- 172.21.15.132:0/3123196828 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c01519c0 0x7f01c01575d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 -- 172.21.15.132:0/3123196828 >> 172.21.15.132:0/3123196828 conn(0x7f01c0075db0 msgr2=0x7f01c0067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 -- 172.21.15.132:0/3123196828 shutdown_connections 2024-04-25T12:51:45.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.514+0000 7f01c5751640 1 -- 172.21.15.132:0/3123196828 wait complete. 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.515+0000 7f01c5751640 1 Processor -- start 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.515+0000 7f01c5751640 1 -- start start 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01c5751640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c00c3a50 0x7f01c0145b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01c5751640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c0146040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01c5751640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 0x7f01c013de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01c5751640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f01c00c7080 con 0x7f01c01519c0 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01c5751640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f01c00c73f0 con 0x7f01c00c95f0 2024-04-25T12:51:45.518 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01c5751640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f01c0073dc0 con 0x7f01c00c3a50 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 0x7f01c013de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 0x7f01c013de10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59188/0 (socket says 172.21.15.132:59188) 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 -- 172.21.15.132:0/2550753657 learned_addr learned my addr 172.21.15.132:0/2550753657 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01beffd640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c00c3a50 0x7f01c0145b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01be7fc640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c0146040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 -- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c00c3a50 msgr2=0x7f01c0145b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c00c3a50 0x7f01c0145b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.519 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 -- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 msgr2=0x7f01c0146040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c0146040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.516+0000 7f01bf7fe640 1 -- 172.21.15.132:0/2550753657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c0147fa0 con 0x7f01c01519c0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.517+0000 7f01bf7fe640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 0x7f01c013de10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f01b80098c0 tx=0x7f01b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.517+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8037040 con 0x7f01c01519c0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.517+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f01b8042070 con 0x7f01c01519c0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.517+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01b8030940 con 0x7f01c01519c0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.517+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c01dd6f0 con 0x7f01c01519c0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.517+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c0148280 con 0x7f01c01519c0 2024-04-25T12:51:45.520 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.518+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c0068d00 con 0x7f01c01519c0 2024-04-25T12:51:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.518+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f01b8030ae0 con 0x7f01c01519c0 2024-04-25T12:51:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.518+0000 7f01a77fe640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f01ac06c8f0 0x7f01ac06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.519+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7f01b80ac8b0 con 0x7f01c01519c0 2024-04-25T12:51:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.519+0000 7f01beffd640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f01ac06c8f0 0x7f01ac06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.519+0000 7f01beffd640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f01ac06c8f0 0x7f01ac06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01b000bfd0 tx=0x7f01b000d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:45.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.523+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f01b807a180 con 0x7f01c01519c0 2024-04-25T12:51:45.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:45.738+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f01c00c89c0 con 0x7f01c01519c0 2024-04-25T12:51:46.396 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.398+0000 7f01a77fe640 1 -- 172.21.15.132:0/2550753657 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f01b807e480 con 0x7f01c01519c0 2024-04-25T12:51:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f01ac06c8f0 msgr2=0x7f01ac06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f01ac06c8f0 0x7f01ac06edb0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f01b000bfd0 tx=0x7f01b000d040 comp rx=0 tx=0).stop 2024-04-25T12:51:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 msgr2=0x7f01c013de10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 0x7f01c013de10 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f01b80098c0 tx=0x7f01b80046c0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 shutdown_connections 2024-04-25T12:51:46.399 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f01ac06c8f0 0x7f01ac06edb0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01c01519c0 0x7f01c013de10 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f01c00c95f0 0x7f01c0146040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 --2- 172.21.15.132:0/2550753657 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f01c00c3a50 0x7f01c0145b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 >> 172.21.15.132:0/2550753657 conn(0x7f01c0075db0 msgr2=0x7f01c014a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 shutdown_connections 2024-04-25T12:51:46.400 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.401+0000 7f01c5751640 1 -- 172.21.15.132:0/2550753657 wait complete. 2024-04-25T12:51:46.411 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T12:51:46.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.515+0000 7fe247108640 1 Processor -- start 2024-04-25T12:51:46.513 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.515+0000 7fe247108640 1 -- start start 2024-04-25T12:51:46.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe247108640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2401444b0 0x7fe2400c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:46.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe247108640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe24015b200 0x7fe24015b650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:46.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe247108640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe24015bfe0 con 0x7fe2400c9520 2024-04-25T12:51:46.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe247108640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7fe24015e790 con 0x7fe2401444b0 2024-04-25T12:51:46.515 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe247108640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe24015e9e0 con 0x7fe24015b200 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2401444b0 0x7fe2400c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2401444b0 0x7fe2400c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59190/0 (socket says 172.21.15.132:59190) 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 -- 172.21.15.132:0/2678482613 learned_addr learned my addr 172.21.15.132:0/2678482613 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 -- 172.21.15.132:0/2678482613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe24015b200 msgr2=0x7fe24015b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 --2- 172.21.15.132:0/2678482613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe24015b200 0x7fe24015b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 -- 172.21.15.132:0/2678482613 >> v1:172.21.15.157:6789/0 conn(0x7fe2400c9520 legacy=0x7fe240067630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:46.516 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.516+0000 7fe244ea4640 1 -- 172.21.15.132:0/2678482613 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24015ecc0 con 0x7fe2401444b0 2024-04-25T12:51:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe244ea4640 1 --2- 172.21.15.132:0/2678482613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2400c8fe0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe234009870 tx=0x7fe23402a210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a444db2ab810cf79 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe23f7fe640 1 -- 172.21.15.132:0/2678482613 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234037070 con 0x7fe2401444b0 2024-04-25T12:51:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe23f7fe640 1 -- 172.21.15.132:0/2678482613 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe234032440 con 0x7fe2401444b0 2024-04-25T12:51:46.517 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe23f7fe640 1 -- 172.21.15.132:0/2678482613 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe234032830 con 0x7fe2401444b0 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 -- 172.21.15.132:0/2678482613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 msgr2=0x7fe2400c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 --2- 172.21.15.132:0/2678482613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2400c8fe0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe234009870 tx=0x7fe23402a210 comp rx=0 tx=0).stop 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 -- 172.21.15.132:0/2678482613 shutdown_connections 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 --2- 172.21.15.132:0/2678482613 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe24015b200 0x7fe24015b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 --2- 172.21.15.132:0/2678482613 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2400c8fe0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 -- 172.21.15.132:0/2678482613 >> 172.21.15.132:0/2678482613 conn(0x7fe2400cd740 msgr2=0x7fe2400cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:46.521 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 -- 172.21.15.132:0/2678482613 shutdown_connections 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.517+0000 7fe247108640 1 -- 172.21.15.132:0/2678482613 wait complete. 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.518+0000 7fe247108640 1 Processor -- start 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 -- start start 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2400c9520 0x7fe2401f5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2401f10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe24015b200 0x7fe240140e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fe240144890 con 0x7fe2401444b0 2024-04-25T12:51:46.522 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fe24015f280 con 0x7fe24015b200 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.519+0000 7fe247108640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fe240068280 con 0x7fe2400c9520 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2401f10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2401f10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59202/0 (socket says 172.21.15.132:59202) 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 -- 172.21.15.132:0/977465219 learned_addr learned my addr 172.21.15.132:0/977465219 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe244ea4640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2400c9520 0x7fe2401f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe2456a5640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe24015b200 0x7fe240140e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 -- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2400c9520 msgr2=0x7fe2401f5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2400c9520 0x7fe2401f5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 -- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe24015b200 msgr2=0x7fe240140e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe24015b200 0x7fe240140e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 -- 172.21.15.132:0/977465219 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2400ccf10 con 0x7fe2401444b0 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe2456a5640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe24015b200 0x7fe240140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe244ea4640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2400c9520 0x7fe2401f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23ffff640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2401f10c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00b3e0 tx=0x7fe22c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c015020 con 0x7fe2401444b0 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fe22c011850 con 0x7fe2401444b0 2024-04-25T12:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe22c011c60 con 0x7fe2401444b0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2401f46d0 con 0x7fe2401444b0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.520+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2401f4970 con 0x7fe2401444b0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.521+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe240068da0 con 0x7fe2401444b0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.522+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe22c018020 con 0x7fe2401444b0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.522+0000 7fe23d7fa640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe22406c920 0x7fe22406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.522+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6850+0+0 (secure 0 0 0) 0x7fe22c08c030 con 0x7fe2401444b0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.522+0000 7fe244ea4640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe22406c920 0x7fe22406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:46.525 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.522+0000 7fe244ea4640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe22406c920 0x7fe22406ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe234034000 tx=0x7fe23402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:46.526 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.526+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe22c01f020 con 0x7fe2401444b0 2024-04-25T12:51:46.701 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:46.703+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe2400c8280 con 0x7fe2401444b0 2024-04-25T12:51:47.609 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.610+0000 7fe23d7fa640 1 -- 172.21.15.132:0/977465219 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7fe22c0172c0 con 0x7fe2401444b0 2024-04-25T12:51:47.609 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2024-04-25T12:51:47.612 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe22406c920 msgr2=0x7fe22406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe22406c920 0x7fe22406ede0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe234034000 tx=0x7fe23402e000 comp rx=0 tx=0).stop 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 msgr2=0x7fe2401f10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2401f10c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe22c00b3e0 tx=0x7fe22c00b8a0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 shutdown_connections 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fe22406c920 0x7fe22406ede0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fe24015b200 0x7fe240140e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.613 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2401444b0 0x7fe2401f10c0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 --2- 172.21.15.132:0/977465219 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fe2400c9520 0x7fe2401f5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.614+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 >> 172.21.15.132:0/977465219 conn(0x7fe2400cd740 msgr2=0x7fe240067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:47.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.615+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 shutdown_connections 2024-04-25T12:51:47.614 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.615+0000 7fe247108640 1 -- 172.21.15.132:0/977465219 wait complete. 2024-04-25T12:51:47.626 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T12:51:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.735+0000 7fd598744640 1 Processor -- start 2024-04-25T12:51:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.735+0000 7fd598744640 1 -- start start 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.736+0000 7fd598744640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd590158190 0x7fd5900cb640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.736+0000 7fd598744640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158a20 0x7fd590151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.736+0000 7fd598744640 1 -- --> v1:172.21.15.157:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5900c89b0 con 0x7fd590158570 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.736+0000 7fd598744640 1 -- --> v2:172.21.15.157:3300/0 -- mon_getmap magic: 0 -- 0x7fd5900c98a0 con 0x7fd590158190 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.736+0000 7fd598744640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd5900c8c90 con 0x7fd590158a20 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd590158190 0x7fd5900cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd596ce1640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158a20 0x7fd590151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 --2- >> v2:172.21.15.157:3300/0 conn(0x7fd590158190 0x7fd5900cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.157:3300/0 says I am v2:172.21.15.132:59060/0 (socket says 172.21.15.132:59060) 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 -- 172.21.15.132:0/1256287204 learned_addr learned my addr 172.21.15.132:0/1256287204 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd595cdf640 1 --1- >> v1:172.21.15.157:6789/0 conn(0x7fd590158570 0x7fd59006e340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.157:6789/0 says I am v1:172.21.15.132:35862/0 (socket says 172.21.15.132:35862) 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 -- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158a20 msgr2=0x7fd590151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 --2- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158a20 0x7fd590151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 -- 172.21.15.132:0/1256287204 >> v1:172.21.15.157:6789/0 conn(0x7fd590158570 legacy=0x7fd59006e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.737+0000 7fd5964e0640 1 -- 172.21.15.132:0/1256287204 --> v2:172.21.15.157:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900c8f70 con 0x7fd590158190 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd5964e0640 1 --2- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158190 0x7fd5900cb640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009e80 tx=0x7fd58c02a750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0e6ee084e91ea9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd5954de640 1 -- 172.21.15.132:0/1256287204 <== mon.1 v2:172.21.15.157:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c036070 con 0x7fd590158190 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd5954de640 1 -- 172.21.15.132:0/1256287204 <== mon.1 v2:172.21.15.157:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd58c031600 con 0x7fd590158190 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd5954de640 1 -- 172.21.15.132:0/1256287204 <== mon.1 v2:172.21.15.157:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c0319f0 con 0x7fd590158190 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 -- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158190 msgr2=0x7fd5900cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 --2- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158190 0x7fd5900cb640 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fd58c009e80 tx=0x7fd58c02a750 comp rx=0 tx=0).stop 2024-04-25T12:51:47.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 -- 172.21.15.132:0/1256287204 shutdown_connections 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 --2- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158a20 0x7fd590151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 --2- 172.21.15.132:0/1256287204 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158190 0x7fd5900cb640 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 -- 172.21.15.132:0/1256287204 >> 172.21.15.132:0/1256287204 conn(0x7fd5900ca340 msgr2=0x7fd5900ca750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 -- 172.21.15.132:0/1256287204 shutdown_connections 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.738+0000 7fd598744640 1 -- 172.21.15.132:0/1256287204 wait complete. 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.739+0000 7fd598744640 1 Processor -- start 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 -- start start 2024-04-25T12:51:47.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 0x7fd5900c4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158570 0x7fd59014b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158a20 0x7fd5901f22a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7fd5900c9d30 con 0x7fd590158190 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7fd5900c9530 con 0x7fd590158a20 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd598744640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7fd5900c4950 con 0x7fd590158570 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd5964e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 0x7fd5900c4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd5964e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 0x7fd5900c4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59214/0 (socket says 172.21.15.132:59214) 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd5964e0640 1 -- 172.21.15.132:0/603660810 learned_addr learned my addr 172.21.15.132:0/603660810 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:47.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd596ce1640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158a20 0x7fd5901f22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.740+0000 7fd595cdf640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158570 0x7fd59014b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd5964e0640 1 -- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158570 msgr2=0x7fd59014b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd5964e0640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158570 0x7fd59014b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd5964e0640 1 -- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158a20 msgr2=0x7fd5901f22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd5964e0640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158a20 0x7fd5901f22a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd5964e0640 1 -- 172.21.15.132:0/603660810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5900c46a0 con 0x7fd590158190 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd5964e0640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 0x7fd5900c4160 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd58c02a790 tx=0x7fd58c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:47.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c036050 con 0x7fd590158190 2024-04-25T12:51:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd58c037040 con 0x7fd590158190 2024-04-25T12:51:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd590155e40 con 0x7fd590158190 2024-04-25T12:51:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd58c009510 con 0x7fd590158190 2024-04-25T12:51:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.741+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5901563e0 con 0x7fd590158190 2024-04-25T12:51:47.744 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.742+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5900cd1f0 con 0x7fd590158190 2024-04-25T12:51:47.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.742+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd58c044020 con 0x7fd590158190 2024-04-25T12:51:47.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.743+0000 7fd586ffd640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd57406c920 0x7fd57406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:47.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.743+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6412+0+0 (secure 0 0 0) 0x7fd58c0ac060 con 0x7fd590158190 2024-04-25T12:51:47.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.743+0000 7fd595cdf640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd57406c920 0x7fd57406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:47.745 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.743+0000 7fd595cdf640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd57406c920 0x7fd57406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd590151f70 tx=0x7fd580007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:47.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.747+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd58c04b020 con 0x7fd590158190 2024-04-25T12:51:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:47.920+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd5900ccde0 con 0x7fd590158190 2024-04-25T12:51:48.616 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.618+0000 7fd586ffd640 1 -- 172.21.15.132:0/603660810 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7fd58c079c10 con 0x7fd590158190 2024-04-25T12:51:48.616 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2024-04-25T12:51:48.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd57406c920 msgr2=0x7fd57406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:48.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd57406c920 0x7fd57406ede0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd590151f70 tx=0x7fd580007e80 comp rx=0 tx=0).stop 2024-04-25T12:51:48.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 msgr2=0x7fd5900c4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:48.619 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 0x7fd5900c4160 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd58c02a790 tx=0x7fd58c004a40 comp rx=0 tx=0).stop 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 shutdown_connections 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7fd57406c920 0x7fd57406ede0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7fd590158a20 0x7fd5901f22a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7fd590158570 0x7fd59014b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 --2- 172.21.15.132:0/603660810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd590158190 0x7fd5900c4160 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 >> 172.21.15.132:0/603660810 conn(0x7fd5900ca340 msgr2=0x7fd59006f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 shutdown_connections 2024-04-25T12:51:48.620 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.621+0000 7fd598744640 1 -- 172.21.15.132:0/603660810 wait complete. 2024-04-25T12:51:48.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-25T12:51:48.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.742+0000 7f59abc19640 1 Processor -- start 2024-04-25T12:51:48.740 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.742+0000 7f59abc19640 1 -- start start 2024-04-25T12:51:48.741 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59abc19640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59a4159ad0 0x7f59a4163270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59abc19640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a41637b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59abc19640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a415fad0 con 0x7f59a415f620 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59abc19640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 -- 0x7f59a4162de0 con 0x7f59a4159ad0 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59abc19640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f59a415fdb0 con 0x7f59a40c7350 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a99b5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59a4159ad0 0x7f59a4163270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a91b4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f59a415f620 0x7f59a40c8140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34214/0 (socket says 172.21.15.132:34214) 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a91b4640 1 -- 172.21.15.132:0/2032741884 learned_addr learned my addr 172.21.15.132:0/2032741884 (peer_addr_for_me v1:172.21.15.132:0/0) 2024-04-25T12:51:48.742 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59aa1b6640 1 --2- 172.21.15.132:0/2032741884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a41637b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:48.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a99b5640 1 -- 172.21.15.132:0/2032741884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 msgr2=0x7f59a41637b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T12:51:48.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a99b5640 1 --2- 172.21.15.132:0/2032741884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a41637b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a99b5640 1 -- 172.21.15.132:0/2032741884 >> v1:172.21.15.132:6789/0 conn(0x7f59a415f620 legacy=0x7f59a40c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:48.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a99b5640 1 -- 172.21.15.132:0/2032741884 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a4160090 con 0x7f59a4159ad0 2024-04-25T12:51:48.743 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.743+0000 7f59a89b3640 1 -- 172.21.15.132:0/2032741884 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1234062671 0 0) 0x7f59a415fad0 con 0x7f59a415f620 2024-04-25T12:51:48.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.744+0000 7f59a99b5640 1 --2- 172.21.15.132:0/2032741884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4159ad0 0x7f59a4163270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59a00097a0 tx=0x7f59a002a100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c2daa21834cf2b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:48.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.744+0000 7f59a89b3640 1 -- 172.21.15.132:0/2032741884 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0037070 con 0x7f59a4159ad0 2024-04-25T12:51:48.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.744+0000 7f59a89b3640 1 -- 172.21.15.132:0/2032741884 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f59a002ae50 con 0x7f59a4159ad0 2024-04-25T12:51:48.746 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.744+0000 7f59a89b3640 1 -- 172.21.15.132:0/2032741884 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59a0032680 con 0x7f59a4159ad0 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 -- 172.21.15.132:0/2032741884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4159ad0 msgr2=0x7f59a4163270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 --2- 172.21.15.132:0/2032741884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4159ad0 0x7f59a4163270 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f59a00097a0 tx=0x7f59a002a100 comp rx=0 tx=0).stop 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 -- 172.21.15.132:0/2032741884 shutdown_connections 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 --2- 172.21.15.132:0/2032741884 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a41637b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 --2- 172.21.15.132:0/2032741884 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a4159ad0 0x7f59a4163270 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 -- 172.21.15.132:0/2032741884 >> 172.21.15.132:0/2032741884 conn(0x7f59a406d380 msgr2=0x7f59a4067630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 -- 172.21.15.132:0/2032741884 shutdown_connections 2024-04-25T12:51:48.747 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.745+0000 7f59abc19640 1 -- 172.21.15.132:0/2032741884 wait complete. 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.746+0000 7f59abc19640 1 Processor -- start 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.746+0000 7f59abc19640 1 -- start start 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.746+0000 7f59abc19640 1 --2- >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a4153fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 --2- >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59a4159ad0 0x7f59a40cb290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 0x7f59a40cb7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40c9de0 con 0x7f59a415f620 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 -- --> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] -- mon_getmap magic: 0 -- 0x7f59a40c9c60 con 0x7f59a4159ad0 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 -- --> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] -- mon_getmap magic: 0 -- 0x7f59a40c8850 con 0x7f59a40c7350 2024-04-25T12:51:48.748 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 0x7f59a40cb7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 0x7f59a40cb7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59234/0 (socket says 172.21.15.132:59234) 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 -- 172.21.15.132:0/3528542498 learned_addr learned my addr 172.21.15.132:0/3528542498 (peer_addr_for_me v2:172.21.15.132:0/0) 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59a99b5640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a4153fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59a91b4640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59a4159ad0 0x7f59a40cb290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 -- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 msgr2=0x7f59a4153fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a4153fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 -- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59a4159ad0 msgr2=0x7f59a40cb290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59a4159ad0 0x7f59a40cb290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:48.749 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 -- 172.21.15.132:0/3528542498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a414b390 con 0x7f59a415f620 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59a99b5640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a4153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59a91b4640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59a4159ad0 0x7f59a40cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59aa1b6640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 0x7f59a40cb7d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f599c007e40 tx=0x7f599c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c014620 con 0x7f59a415f620 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f599c019070 con 0x7f59a415f620 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c014a40 con 0x7f59a415f620 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a414b610 con 0x7f59a415f620 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.747+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a40ca7b0 con 0x7f59a415f620 2024-04-25T12:51:48.750 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.748+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a4068da0 con 0x7f59a415f620 2024-04-25T12:51:48.751 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.749+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f599c014be0 con 0x7f59a415f620 2024-04-25T12:51:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.749+0000 7f599a7fc640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f598806c8f0 0x7f598806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T12:51:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.749+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5853+0+0 (secure 0 0 0) 0x7f599c08c520 con 0x7f59a415f620 2024-04-25T12:51:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.749+0000 7f59a99b5640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f598806c8f0 0x7f598806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T12:51:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.749+0000 7f59a99b5640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f598806c8f0 0x7f598806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59a0034000 tx=0x7f59a002e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T12:51:48.752 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.753+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f59a414b390 con 0x7f59a415f620 2024-04-25T12:51:48.925 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:48.927+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f59a4067630 con 0x7f59a415f620 2024-04-25T12:51:49.623 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.625+0000 7f599a7fc640 1 -- 172.21.15.132:0/3528542498 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f599c05a8c0 con 0x7f59a415f620 2024-04-25T12:51:49.623 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data_ec' removed 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f598806c8f0 msgr2=0x7f598806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f598806c8f0 0x7f598806edb0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f59a0034000 tx=0x7f59a002e000 comp rx=0 tx=0).stop 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 msgr2=0x7f59a40cb7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 0x7f59a40cb7d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f599c007e40 tx=0x7f599c00e4b0 comp rx=0 tx=0).stop 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 shutdown_connections 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:6832/1781084722,v1:172.21.15.132:6833/1781084722] conn(0x7f598806c8f0 0x7f598806edb0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:49.626 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59a415f620 0x7f59a40cb7d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:49.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3300/0,v1:172.21.15.157:6789/0] conn(0x7f59a4159ad0 0x7f59a40cb290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:49.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 --2- 172.21.15.132:0/3528542498 >> [v2:172.21.15.157:3301/0,v1:172.21.15.157:6790/0] conn(0x7f59a40c7350 0x7f59a4153fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T12:51:49.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 >> 172.21.15.132:0/3528542498 conn(0x7f59a406d380 msgr2=0x7f59a406e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T12:51:49.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.627+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 shutdown_connections 2024-04-25T12:51:49.627 INFO:teuthology.orchestra.run.smithi132.stderr:2024-04-25T12:51:49.628+0000 7f59abc19640 1 -- 172.21.15.132:0/3528542498 wait complete. 2024-04-25T12:51:49.639 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T12:51:49.640 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T12:51:49.640 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.649 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T12:51:49.649 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T12:51:49.649 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.699 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T12:51:49.699 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-25T12:51:49.699 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.749 INFO:tasks.ceph.mds.e:Stopped 2024-04-25T12:51:49.749 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T12:51:49.749 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.760 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T12:51:49.761 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-25T12:51:49.761 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.812 INFO:tasks.ceph.mds.d:Stopped 2024-04-25T12:51:49.812 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-25T12:51:49.812 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.864 INFO:tasks.ceph.mds.f:Stopped 2024-04-25T12:51:49.864 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T12:51:49.864 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T12:51:49.864 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.897 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T12:51:49.898 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T12:51:49.898 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:49.969 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T12:51:49.970 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T12:51:49.970 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.046 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T12:51:50.046 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T12:51:50.046 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.114 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T12:51:50.115 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-25T12:51:50.115 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.145 INFO:tasks.ceph.osd.4:Stopped 2024-04-25T12:51:50.145 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-25T12:51:50.145 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.221 INFO:tasks.ceph.osd.5:Stopped 2024-04-25T12:51:50.221 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-25T12:51:50.221 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.288 INFO:tasks.ceph.osd.6:Stopped 2024-04-25T12:51:50.288 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-25T12:51:50.288 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.365 INFO:tasks.ceph.osd.7:Stopped 2024-04-25T12:51:50.365 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T12:51:50.365 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T12:51:50.365 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.391 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T12:51:50.391 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T12:51:50.392 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.430 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T12:51:50.431 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T12:51:50.431 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T12:51:50.431 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.443 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T12:51:50.444 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T12:51:50.444 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.483 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T12:51:50.483 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T12:51:50.483 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T12:51:50.534 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T12:51:50.534 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T12:51:50.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-25T12:51:50.575 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:51:50.575 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T12:51:50.852 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:51:50.852 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T12:51:50.924 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:51:50.924 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T12:51:50.987 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:51:50.988 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T12:51:51.054 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:51:51.055 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-25T12:51:51.358 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:51:51.358 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-25T12:51:51.423 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:51:51.423 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-25T12:51:51.480 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:51:51.481 DEBUG:teuthology.orchestra.run.smithi157:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-25T12:51:51.529 INFO:tasks.ceph:Archiving mon data... 2024-04-25T12:51:51.530 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/data/mon.a.tgz 2024-04-25T12:51:51.530 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2024-04-25T12:51:51.547 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.oHhv8VL3C0 2024-04-25T12:51:51.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.oHhv8VL3C0 2024-04-25T12:51:51.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.oHhv8VL3C0 2024-04-25T12:51:51.751 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.oHhv8VL3C0 is 271KB 2024-04-25T12:51:51.816 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.oHhv8VL3C0 2024-04-25T12:51:51.830 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/data/mon.b.tgz 2024-04-25T12:51:51.831 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-25T12:51:51.847 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.GN4L6nZGzU 2024-04-25T12:51:51.848 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.GN4L6nZGzU 2024-04-25T12:51:52.026 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.GN4L6nZGzU 2024-04-25T12:51:52.108 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.GN4L6nZGzU is 371KB 2024-04-25T12:51:52.204 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.GN4L6nZGzU 2024-04-25T12:51:52.218 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/data/mon.c.tgz 2024-04-25T12:51:52.218 DEBUG:teuthology.orchestra.run.smithi157:> mktemp 2024-04-25T12:51:52.272 INFO:teuthology.orchestra.run.smithi157.stdout:/tmp/tmp.V3Zm9kuEJw 2024-04-25T12:51:52.272 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.V3Zm9kuEJw 2024-04-25T12:51:52.399 DEBUG:teuthology.orchestra.run.smithi157:> sudo chmod 0666 /tmp/tmp.V3Zm9kuEJw 2024-04-25T12:51:52.479 DEBUG:teuthology.orchestra.remote:smithi157:/tmp/tmp.V3Zm9kuEJw is 371KB 2024-04-25T12:51:52.574 DEBUG:teuthology.orchestra.run.smithi157:> rm -fr /tmp/tmp.V3Zm9kuEJw 2024-04-25T12:51:52.589 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T12:51:52.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T12:51:52.591 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T12:51:52.669 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T12:51:52.706 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T12:51:52.706 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T12:51:52.708 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/remote/smithi132/crash 2024-04-25T12:51:52.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T12:51:52.733 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/remote/smithi157/crash 2024-04-25T12:51:52.734 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T12:51:52.769 INFO:tasks.ceph:Shutting down logrotate 2024-04-25T12:51:52.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:52.778 DEBUG:teuthology.orchestra.run.smithi157:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:52.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:52.884 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-25T12:51:52.907 INFO:tasks.ceph:Compressing logs... 2024-04-25T12:51:52.908 DEBUG:teuthology.orchestra.run.smithi132:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T12:51:52.927 DEBUG:teuthology.orchestra.run.smithi157:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T12:51:52.948 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40424.log 2024-04-25T12:51:52.948 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42834.log 2024-04-25T12:51:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-04-25T12:51:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34550.log 2024-04-25T12:51:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34470.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T12:51:53.002 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34550.log: gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz -5 2024-04-25T12:51:53.002 INFO:teuthology.orchestra.run.smithi157.stderr: --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-25T12:51:53.002 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34550.log.gz 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose 91.4% -- /var/log/ceph/ceph-osd.4.log -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34414.log 2024-04-25T12:51:53.003 INFO:teuthology.orchestra.run.smithi157.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34674.log 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34414.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34374.log 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34414.log.gz 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34674.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34674.log.gz 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34374.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mgr.x.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34374.log.gz 2024-04-25T12:51:53.004 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34630.log 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34590.log 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34630.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34630.log.gz 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34510.log 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34590.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34590.log.gz 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-client.admin.34510.log: 92.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T12:51:53.005 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mds.d.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34510.log.gz 2024-04-25T12:51:53.006 INFO:teuthology.orchestra.run.smithi157.stderr:/var/log/ceph/ceph-mon.b.log: 91.1% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-25T12:51:53.007 INFO:teuthology.orchestra.run.smithi157.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-25T12:51:53.031 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40681.log 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40424.log: /var/log/ceph/ceph-client.admin.42834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42320.log 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.40424.log.gz 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40681.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40911.log 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45692.log 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.28302.log 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42546.log 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42834.log.gz 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42320.log: /var/log/ceph/ceph-client.admin.40911.log: /var/log/ceph/ceph-client.admin.45692.log: /var/log/ceph/ceph.tmp-client.admin.28302.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.40681.log.gz 2024-04-25T12:51:53.032 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44019.log 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42320.log.gz 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.28302.log.gz 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.40911.log.gz 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45692.log.gz 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40725.log 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42546.log.gz 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41295.log 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40725.log: gzip 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44019.log.gz 2024-04-25T12:51:53.033 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43902.log 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41295.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40725.log.gz 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41295.log.gz 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43902.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43702.log 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43902.log.gz 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47119.log 2024-04-25T12:51:53.034 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41253.log 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47119.log: gzip 88.5% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.43702.log.gz -- 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr: /var/log/ceph/ceph-client.admin.44616.log 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr: 84.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47119.log.gz 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46623.log 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45608.log 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41253.log.gz 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41421.log 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44616.log.gz 2024-04-25T12:51:53.035 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46623.log: /var/log/ceph/ceph-client.admin.45608.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46623.log.gz 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41421.log: gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.45608.log.gz 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr: --verbose -- /var/log/ceph/ceph-client.admin.43368.log 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44910.log 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40639.log 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.41421.log.gz 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44910.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43368.log.gz 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42750.log 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44910.log.gz 2024-04-25T12:51:53.036 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45951.log 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46119.log 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.40639.log.gz 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42750.log.gz 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42894.log 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45951.log.gz 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41337.log 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42894.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46119.log.gz 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42894.log.gz 2024-04-25T12:51:53.037 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43703.log 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41337.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43703.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41337.log.gz 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43370.log 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph.audit.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43703.log.gz 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44238.log 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41487.log 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43370.log.gz 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44658.log 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T12:51:53.038 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43188.log 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41487.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44238.log.gz 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44658.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.41487.log.gz 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43188.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44658.log.gz 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44952.log 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.3.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43188.log.gzgzip 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.44021.log 2024-04-25T12:51:53.039 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43701.log 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44021.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44021.log.gz 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44952.log.gz 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44280.log 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46329.log 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mds.c.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43701.log.gz 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46455.log 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44280.log: /var/log/ceph/ceph-client.admin.46329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43706.log 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44280.log.gz 2024-04-25T12:51:53.040 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.46329.log.gz 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40331.log 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.46455.log.gz 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.46077.log 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43706.log: /var/log/ceph/ceph-client.admin.40331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44020.log 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43706.log.gz 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.40331.log.gz 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46077.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T12:51:53.041 INFO:teuthology.orchestra.run.smithi132.stderr: 89.3%/var/log/ceph/ceph-client.admin.44020.log: -- replaced with /var/log/ceph/ceph-client.admin.46077.log.gz 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.1.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44020.log.gz 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47035.log 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44022.log 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.47035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42462.log 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47035.log.gz 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40869.log 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44022.log.gz 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42462.log: --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T12:51:53.042 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40869.log: 88.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.42462.log.gz 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.40869.log.gz 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44868.log 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46497.log 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3%/var/log/ceph/ceph-client.admin.44868.log: -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44868.log.gz 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45080.log 2024-04-25T12:51:53.043 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0%/var/log/ceph/ceph-client.admin.46993.log: -- replaced with /var/log/ceph/ceph-client.admin.46497.log.gz 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43062.log 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46581.log 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45080.log.gz/var/log/ceph/ceph-client.admin.43062.log: 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47245.log 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43062.log.gz 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45566.log 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46581.log.gz/var/log/ceph/ceph-client.admin.47245.log: 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45909.log 2024-04-25T12:51:53.044 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47245.log.gz 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44043.log 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45566.log: /var/log/ceph/ceph-client.admin.45909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44700.log 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44043.log: 88.9% 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45909.log.gz 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45566.log.gz 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44043.log.gz 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40955.log 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43020.log 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44700.log.gz 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.40955.log: /var/log/ceph/ceph-mon.a.log 2024-04-25T12:51:53.045 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43020.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.40955.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42362.log 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43020.log.gz 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46707.log 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44406.log 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0%/var/log/ceph/ceph-client.admin.46707.log: -- replaced with /var/log/ceph/ceph-client.admin.42362.log.gz 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46707.log.gz 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42152.log 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44364.log 2024-04-25T12:51:53.046 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44406.log.gz 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47161.log 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44364.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42152.log.gz 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44364.log.gz 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41041.log 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44490.log 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.47161.log: /var/log/ceph/ceph-client.admin.41041.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47161.log.gz 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41041.log.gz 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43365.log 2024-04-25T12:51:53.047 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44574.log 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44490.log: /var/log/ceph/ceph-client.admin.43365.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44490.log.gz 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43365.log.gz 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44532.log 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46951.log 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44532.log: /var/log/ceph/ceph-client.admin.44574.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44574.log.gz 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44532.log.gz 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41211.log 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41911.log 2024-04-25T12:51:53.048 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46951.log: /var/log/ceph/ceph-client.admin.41211.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46951.log.gz 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41211.log.gz 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43362.log 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42588.log 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41911.log: /var/log/ceph/ceph-client.admin.43362.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43362.log.gz 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41083.log 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42588.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42588.log.gz 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46287.log 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41083.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.41911.log.gz 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44013.log 2024-04-25T12:51:53.049 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.41083.log.gz 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43146.log 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44013.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.46287.log.gz 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44013.log.gz 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44322.log 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45399.log 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43146.log: /var/log/ceph/ceph-client.admin.44322.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43146.log.gz 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.44322.log.gz 2024-04-25T12:51:53.050 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41169.log 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43367.log 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41169.log: /var/log/ceph/ceph-client.0.45399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.45399.log.gz 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43366.log 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41169.log.gz 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44018.log 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43366.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43367.log.gz 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43366.log.gz 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47203.log 2024-04-25T12:51:53.051 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46909.log 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44018.log: /var/log/ceph/ceph-client.admin.47203.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44018.log.gz 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47203.log.gz 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45993.log 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41127.log 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46909.log: /var/log/ceph/ceph-client.admin.45993.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46909.log.gz 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45993.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46809.log 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41127.log: /var/log/ceph/ceph-mds.e.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41127.log.gz 2024-04-25T12:51:53.052 INFO:teuthology.orchestra.run.smithi132.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42194.log 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42504.log 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46809.log.gz 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42504.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42194.log.gz 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43698.log 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42504.log.gz 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.44784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34725.log 2024-04-25T12:51:53.053 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43698.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43698.log.gz 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46161.log 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43369.log 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46161.log: /var/log/ceph/ceph-client.admin.34725.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.34725.log.gz 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.46161.log.gz 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40767.log 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44826.log 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43369.log: /var/log/ceph/ceph-client.admin.40767.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43369.log.gz 2024-04-25T12:51:53.054 INFO:teuthology.orchestra.run.smithi132.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.40767.log.gz 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45776.log 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46371.log 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45776.log: /var/log/ceph/ceph-client.admin.44826.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44826.log.gz 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45776.log.gz 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44742.log 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46539.log 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46371.log: /var/log/ceph/ceph-client.admin.44742.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46371.log.gz 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.44742.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2024-04-25T12:51:53.055 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47077.log 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43687.log: /var/log/ceph/ceph-client.admin.46539.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46539.log.gz 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46413.log 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.47077.log: -- /var/log/ceph/ceph-client.admin.45650.log 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr: 88.0% 91.7% -- replaced with /var/log/ceph/ceph-client.admin.47077.log.gz 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-mgr.y.log.gz/var/log/ceph/ceph-client.admin.46413.log: 2024-04-25T12:51:53.056 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34622.log 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46413.log.gz 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40827.log 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr: -- replaced with /var/log/ceph/ceph-client.admin.45650.log.gz 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.34622.log: /var/log/ceph/ceph-client.admin.40827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46203.log 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34622.log.gz/var/log/ceph/ceph-client.admin.44448.log: 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40827.log.gz 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42278.log 2024-04-25T12:51:53.057 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46203.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42708.log 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr: 87.7%/var/log/ceph/ceph-client.admin.42278.log: -- replaced with /var/log/ceph/ceph-client.admin.46203.log.gz 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42792.log 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42278.log.gz 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45734.log 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42708.log: /var/log/ceph/ceph-client.admin.42792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43104.log 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.45734.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42708.log.gz 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42792.log.gz 2024-04-25T12:51:53.058 INFO:teuthology.orchestra.run.smithi132.stderr:gzip 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45734.log.gz 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43704.log 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42630.log 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43104.log.gz 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40539.log 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43704.log.gz/var/log/ceph/ceph-client.admin.42630.log: 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42630.log.gz 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40999.log 2024-04-25T12:51:53.059 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40539.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42978.log 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.40999.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40539.log.gz 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46749.log 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40999.log.gz 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr:gzip/var/log/ceph/ceph-client.admin.42978.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.43705.log 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46749.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42978.log.gz 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43359.log 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr: 87.5%/var/log/ceph/ceph-client.admin.43705.log: -- replaced with /var/log/ceph/ceph-client.admin.46749.log.gz 2024-04-25T12:51:53.060 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42936.log 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43705.log.gz 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.43359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34360.log 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43359.log.gz 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41379.log 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42936.log: /var/log/ceph/ceph-client.admin.34360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42420.log 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.41379.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42936.log.gz 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.34360.log.gz 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46035.log 2024-04-25T12:51:53.061 INFO:teuthology.orchestra.run.smithi132.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41379.log.gz 2024-04-25T12:51:53.062 INFO:teuthology.orchestra.run.smithi132.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42236.log 2024-04-25T12:51:53.062 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42420.log: gzip/var/log/ceph/ceph-client.admin.46035.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.46665.log 2024-04-25T12:51:53.062 INFO:teuthology.orchestra.run.smithi132.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42420.log.gz 2024-04-25T12:51:53.062 INFO:teuthology.orchestra.run.smithi132.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46035.log.gz 2024-04-25T12:51:53.062 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.42236.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.42236.log.gz 2024-04-25T12:51:53.062 INFO:teuthology.orchestra.run.smithi132.stderr:/var/log/ceph/ceph-client.admin.46665.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46665.log.gz 2024-04-25T12:51:53.063 INFO:teuthology.orchestra.run.smithi157.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T12:51:53.063 INFO:teuthology.orchestra.run.smithi157.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T12:51:53.114 INFO:teuthology.orchestra.run.smithi132.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T12:51:53.544 INFO:teuthology.orchestra.run.smithi132.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T12:51:53.549 INFO:teuthology.orchestra.run.smithi132.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T12:51:53.555 INFO:teuthology.orchestra.run.smithi132.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T12:51:53.577 INFO:teuthology.orchestra.run.smithi157.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-25T12:51:53.605 INFO:teuthology.orchestra.run.smithi157.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-25T12:51:53.616 INFO:teuthology.orchestra.run.smithi157.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-25T12:51:53.625 INFO:teuthology.orchestra.run.smithi132.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T12:51:53.627 INFO:teuthology.orchestra.run.smithi132.stderr: 2024-04-25T12:51:53.627 INFO:teuthology.orchestra.run.smithi132.stderr:real 0m0.689s 2024-04-25T12:51:53.628 INFO:teuthology.orchestra.run.smithi132.stderr:user 0m2.599s 2024-04-25T12:51:53.628 INFO:teuthology.orchestra.run.smithi132.stderr:sys 0m0.181s 2024-04-25T12:51:53.660 INFO:teuthology.orchestra.run.smithi157.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-25T12:51:53.662 INFO:teuthology.orchestra.run.smithi157.stderr: 2024-04-25T12:51:53.663 INFO:teuthology.orchestra.run.smithi157.stderr:real 0m0.694s 2024-04-25T12:51:53.663 INFO:teuthology.orchestra.run.smithi157.stderr:user 0m2.622s 2024-04-25T12:51:53.663 INFO:teuthology.orchestra.run.smithi157.stderr:sys 0m0.109s 2024-04-25T12:51:53.663 INFO:tasks.ceph:Archiving logs... 2024-04-25T12:51:53.663 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/remote/smithi132/log 2024-04-25T12:51:53.665 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T12:51:54.150 DEBUG:teuthology.misc:Transferring archived files from smithi157:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/remote/smithi157/log 2024-04-25T12:51:54.151 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T12:51:54.520 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T12:51:54.529 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T12:51:54.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T12:51:54.532 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T12:51:54.615 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T12:51:54.624 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T12:51:54.624 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:51:54.627 DEBUG:teuthology.orchestra.run.smithi157:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T12:51:54.638 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2024-04-25T12:51:54.640 INFO:teuthology.orchestra.run.smithi157.stderr:bash: line 1: ntpq: command not found 2024-04-25T12:51:54.643 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T12:51:54.643 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2024-04-25T12:51:54.643 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv01.front.sepia.ceph.com 3 6 377 2 +858us[ +844us] +/- 57ms 2024-04-25T12:51:54.643 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 1 -1250us[-1250us] +/- 66ms 2024-04-25T12:51:54.643 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 2 +285us[ +271us] +/- 73ms 2024-04-25T12:51:54.643 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:51:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T12:51:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:=============================================================================== 2024-04-25T12:51:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:^* hv01.front.sepia.ceph.com 3 6 377 3 +880us[ +862us] +/- 57ms 2024-04-25T12:51:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 3 -1238us[-1238us] +/- 66ms 2024-04-25T12:51:54.644 INFO:teuthology.orchestra.run.smithi157.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 3 +305us[ +305us] +/- 73ms 2024-04-25T12:51:54.645 INFO:teuthology.orchestra.run.smithi157.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T12:51:54.645 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T12:51:54.654 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T12:51:54.654 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T12:51:54.662 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T12:51:54.745 DEBUG:teuthology.orchestra.run.smithi157:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T12:51:54.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T12:51:54.827 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:51:54.827 DEBUG:teuthology.orchestra.run.smithi157:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-25T12:51:54.853 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:51:54.853 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T12:51:54.862 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T12:51:54.870 INFO:teuthology.task.internal:Duration was 500.905581 seconds 2024-04-25T12:51:54.871 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T12:51:54.879 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T12:51:54.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T12:51:54.882 DEBUG:teuthology.orchestra.run.smithi157:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T12:51:54.916 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T12:51:54.929 INFO:teuthology.orchestra.run.smithi157.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T12:51:55.289 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T12:51:55.289 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2024-04-25T12:51:55.290 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T12:51:55.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi157.front.sepia.ceph.com 2024-04-25T12:51:55.349 DEBUG:teuthology.orchestra.run.smithi157:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T12:51:55.375 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T12:51:55.375 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T12:51:55.392 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T12:51:55.441 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T12:51:55.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T12:51:55.457 DEBUG:teuthology.orchestra.run.smithi157:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T12:51:55.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T12:51:55.584 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T12:51:55.585 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T12:51:55.608 DEBUG:teuthology.orchestra.run.smithi157:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T12:51:55.631 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T12:51:55.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:51:55.651 DEBUG:teuthology.orchestra.run.smithi157:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:51:55.670 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2024-04-25T12:51:55.694 INFO:teuthology.orchestra.run.smithi157.stdout:kernel.core_pattern = core 2024-04-25T12:51:55.716 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:51:55.736 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:51:55.737 DEBUG:teuthology.orchestra.run.smithi157:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T12:51:55.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T12:51:55.771 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T12:51:55.780 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T12:51:55.781 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/remote/smithi132 2024-04-25T12:51:55.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T12:51:55.813 DEBUG:teuthology.misc:Transferring archived files from smithi157:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448/remote/smithi157 2024-04-25T12:51:55.813 DEBUG:teuthology.orchestra.run.smithi157:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T12:51:55.845 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T12:51:55.845 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T12:51:55.850 DEBUG:teuthology.orchestra.run.smithi157:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T12:51:55.894 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T12:51:55.905 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T12:51:55.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T12:51:55.914 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T12:51:55.915 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T12:51:55.917 DEBUG:teuthology.orchestra.run.smithi157:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T12:51:55.929 INFO:teuthology.orchestra.run.smithi132.stdout: 262213 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 12:51 /home/ubuntu/cephtest 2024-04-25T12:51:55.949 INFO:teuthology.orchestra.run.smithi157.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 12:51 /home/ubuntu/cephtest 2024-04-25T12:51:55.950 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T12:51:55.960 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T12:51:55.981 INFO:teuthology.nuke:Checking targets against current locks 2024-04-25T12:51:56.006 DEBUG:teuthology.nuke:shortname: smithi132 2024-04-25T12:51:56.006 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:51:56.035 DEBUG:teuthology.nuke:shortname: smithi157 2024-04-25T12:51:56.035 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T12:51:56.038 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:37:27.234812', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMuNkucXJ59SCCtKF9QP3S/igSOJVVar6YZHqvGRg/PZNNcojFxZfKZIT+B6eAt7JKG80Vn1P2cImAhhzrdwapE='} 2024-04-25T12:51:56.061 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi157.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-25_12:17:05-fs-wip-lusov-quiescer-distro-default-smithi/7673448', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 12:37:27.236291', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFIN6oMNfw4CzQMukc5lb6k7IFKiz9TxPa2AnDYcuE1VjUzAcxklYW5IFuOjAwz6YhvLzaraq0FcFETCAUZwezo='} 2024-04-25T12:51:56.094 INFO:teuthology.orchestra.console.smithi132:Power off 2024-04-25T12:51:56.094 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T12:51:56.112 INFO:teuthology.orchestra.console.smithi157:Power off 2024-04-25T12:51:56.113 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-25T12:51:56.122 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2024-04-25T12:51:56.122 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:51:56.135 DEBUG:teuthology.orchestra.console.smithi157:power off output: Chassis Power Control: Down/Off 2024-04-25T12:51:56.136 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:51:56.144 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-25T12:51:56.160 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-04-25T12:52:00.145 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:52:00.161 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:52:00.257 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-25T12:52:00.270 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is on 2024-04-25T12:52:04.258 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:52:04.271 DEBUG:teuthology.orchestra.console.smithi157:pexpect command: ipmitool -H smithi157.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:52:04.368 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2024-04-25T12:52:04.379 DEBUG:teuthology.orchestra.console.smithi157:check power output: Chassis Power is off 2024-04-25T12:52:04.479 INFO:teuthology.orchestra.console.smithi157:Power off completed 2024-04-25T12:52:08.370 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-25T12:52:08.479 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2024-04-25T12:52:08.580 INFO:teuthology.orchestra.console.smithi132:Power off completed 2024-04-25T12:52:08.685 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/1 tasks/{1-thrash/with-quiesce 2-workunit/fs/snaps}} duration: 500.90558075904846 failure_reason: '''NoneType'' object has no attribute ''get''' flavor: default owner: scheduled_leonidus@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=46ef4c0b59d445439e9d0344fe9d72ac status: fail success: false 2024-04-25T12:52:08.685 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T12:52:08.770 INFO:teuthology.run:FAIL